00000001:02000400:3.0F:1783968992.626372:0:3301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1783969015.418984:0:3522:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1783969017.932978:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 571 MB/s 00000001:01000000:2.0:1783969018.185977:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 573 MB/s 00000001:01000000:2.0:1783969018.436212:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4271 MB/s 00000020:02000000:2.0:1783969019.448028:0:3614:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_g313aea1 00000400:02000000:1.0:1783969020.651761:0:3629:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.201.134@tcp [8/256/0/180] 00008000:02000000:2.0:1783969024.375284:0:3779:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783969094.050269:0:5748:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000020:01000004:0.0F:1783969107.554242:0:6498:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783969107.554261:0:6498:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783969107.554263:0:6498:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783969107.554459:0:6498:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000007963f961 00000080:02000400:0.0:1783969107.554473:0:6498:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1783969107.563328:0:6498:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1783969107.566044:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783969107.566081:0:6498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000035edbe4) 00000020:00000080:0.0:1783969107.566109:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783969107.665276:0:6498:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783969107.666171:0:6498:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1783969107.727442:0:6498:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783969107.728758:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783969107.728770:0:6498:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783969107.728787:0:6498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cb95be 00000020:01000004:0.0:1783969107.728797:0:6498:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783969107.728802:0:6498:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783969107.728808:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007963f961 from MGS 00000020:01000004:0.0:1783969107.728814:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783969107.728828:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c21ce695) 00000020:00000080:0.0:1783969107.728856:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783969107.728937:0:6498:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007963f961 from MGS, refs=2 00080000:01000000:0.0:1783969107.728943:0:6498:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783969107.728948:0:6498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cb95cc 00000100:00100000:0.0:1783969107.729088:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783969107.729231:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783969107.729238:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1783969107.732761:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1783969107.732775:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783969107.735866:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969107.736285:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783969107.736294:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783969107.737585:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1783969107.737657:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783969107.738217:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783969107.738227:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783969107.739221:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969107.739226:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969107.739228:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969107.739601:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969107.739604:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969107.739606:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969107.740328:0:6498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783969107.749207:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1783969107.989467:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2811 MB/s 00000001:01000000:3.0:1783969108.239466:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3327 MB/s 00000001:01000000:2.0:1783969108.489913:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 427 MB/s 00000001:01000000:3.0:1783969108.741174:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 617 MB/s 00080000:10000000:3.0:1783969108.749528:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1783969108.775433:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783969108.780509:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783969108.780576:0:6498:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783969108.780635:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783969108.780846:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783969108.780870:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783969108.781288:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969108.789759:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783969108.789773:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:2.0:1783969108.789905:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969108.790753:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783969108.790762:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783969108.792636:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783969108.792649:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783969108.793711:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783969108.793734:0:6498:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.134@tcp' 00000020:01000004:1.0:1783969108.793737:0:6498:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783969108.793777:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.134@tcp (typ=mgc) 00000020:00000080:1.0:1783969108.793800:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.134@tcp (00000000dffceb8a) 00000020:00000080:1.0:1783969108.793820:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783969108.793977:0:6498:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001ab8695c@MGC192.168.201.134@tcp: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1783969108.794130:0:6498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.134@tcp-0 is initialized 00000040:01000000:1.0:1783969108.794136:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 1 is initialized 00000100:00080000:2.0:1783969108.794447:0:6517:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1783969108.795482:0:6518:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783969108.795553:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.134@tcp (uuid bfed4274-bbe1-4392-be5b-cfbff577e88d) 00000020:00000080:2.0:1783969108.795575:0:6498:0:(genops.c:1406:class_connect()) connect: client bfed4274-bbe1-4392-be5b-cfbff577e88d, cookie 0xea31253a47cb95da 00000100:00080000:2.0:1783969108.795587:0:6498:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783969108.795592:0:6498:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import 000000001ab8695c using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969108.795635:0:6498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b0188bc7 x1870627099115648/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969108.795663:0:6498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS 00000020:01000004:2.0:1783969108.795681:0:6498:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783969108.795702:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783969108.795722:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003a3c0d16) 00000020:00000080:2.0:1783969108.795733:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1783969108.795990:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0188bc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfed4274-bbe1-4392-be5b-cfbff577e88d:3645:1870627099115648:0@lo:250: 00000100:00100000:1.0:1783969108.796083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969108.796902:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099115648 00000100:00100000:0.0:1783969108.796913:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099115648 00000100:00100000:0.0:1783969108.796946:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969108.796953:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dc11693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1870627099115648:12345-0@lo:250: 00010000:00080000:0.0:1783969108.796985:0:6514:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bfed4274-bbe1-4392-be5b-cfbff577e88d@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:0.0:1783969108.797027:0:6514:0:(genops.c:1406:class_connect()) connect: client bfed4274-bbe1-4392-be5b-cfbff577e88d, cookie 0xea31253a47cb95e8 00000100:00080000:0.0:1783969108.797160:0:6514:0:(import.c:65:import_set_state_nolock()) 00000000f33ca52f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969108.797217:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dc11693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:3645:x1870627099115648:12345-0@lo:250: Request processed in 263us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969108.797225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969108.797265:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1783969108.797274:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.134@tcp: connect to target with instance 0 00000100:00080000:0.0:1783969108.797282:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783969108.797287:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783969108.797289:0:3645:0:(import.c:65:import_set_state_nolock()) 000000001ab8695c MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783969108.797292:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783969108.797299:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783969108.797303:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0188bc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfed4274-bbe1-4392-be5b-cfbff577e88d:3645:1870627099115648:0@lo:250: 00000100:00100000:0.0:1783969108.821000:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969108.821269:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1783969108.821276:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783969108.821999:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783969108.822007:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783969108.822755:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783969108.822764:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783969108.823908:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969108.824239:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783969108.824246:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783969108.824876:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783969108.824883:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783969108.867650:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969108.867859:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783969108.867865:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783969108.878542:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783969108.878558:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783969108.879293:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969108.879499:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783969108.879504:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783969108.880069:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783969108.880075:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783969108.880661:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969108.880814:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783969108.880819:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783969108.882193:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783969108.882204:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783969108.882871:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969108.883017:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783969108.883023:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783969108.884375:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783969108.884407:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1783969108.920278:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969108.920526:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783969108.920533:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783969108.926873:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783969108.926893:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783969108.928240:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783969108.928253:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1783969108.929254:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1783969108.929284:0:6498:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1783969108.929291:0:6498:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783969108.929547:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783969108.929586:0:6498:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1783969108.929591:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783969108.929593:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783969108.929594:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969108.929595:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969108.929597:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969108.929598:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969108.929599:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783969108.929601:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783969108.929603:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783969108.929604:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783969108.929605:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969108.929607:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783969108.929610:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1783969108.929612:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783969108.929613:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783969108.929615:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969108.929616:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969108.929621:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969108.929622:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969108.929623:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783969108.929624:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783969108.929625:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783969108.929626:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783969108.929626:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969108.929627:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783969108.929658:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783969108.929675:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000402dcf52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099115776:0@lo:253: 00000100:00100000:3.0:1783969108.929749:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969108.929853:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e141007d going to sleep for 11 seconds 00000100:00100000:1.0:1783969108.929900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099115776 00000100:00100000:1.0:1783969108.929908:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099115776 00000100:00100000:1.0:1783969108.929984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969108.929993:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:6498:x1870627099115776:12345-0@lo:253: 20000000:01000000:1.0:1783969108.930043:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783969108.930045:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1783969108.930576:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783969108.930641:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1783969108.930915:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969108.932237:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1783969108.932522:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783969108.932526:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1783969108.932532:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1783969108.932535:0:6516:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1783969108.932546:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1783969108.932698:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969108.932870:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1783969108.932883:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783969108.932900:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1783969108.932915:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1783969108.932928:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1783969108.932978:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1783969108.932986:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1783969108.933009:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1783969108.933016:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1783969108.933028:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1783969108.933032:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1783969108.933044:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1783969108.933059:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1783969108.933085:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783969108.933089:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1783969108.933096:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969108.933178:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1783969108.933188:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783969108.933202:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1783969108.933216:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1783969108.933243:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1783969108.933252:0:6516:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1783969108.933274:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1783969108.933282:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783969108.933292:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1783969108.933305:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1783969108.933318:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1783969108.933326:0:6516:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1783969108.933346:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1783969108.933354:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1783969108.933751:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1783969108.933781:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1783969108.933856:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1783969108.933878:0:6516:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1783969108.933885:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1783969108.934348:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783969108.934693:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783969108.934713:0:6516:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.134@tcp for mdt 20000000:01000000:1.0:1783969108.934716:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:1.0:1783969108.934728:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783969108.934743:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783969108.934757:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783969108.934761:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:1.0:1783969108.934771:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783969108.934778:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783969108.934788:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783969108.934802:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783969108.934838:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783969108.934841:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783969108.934845:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783969108.934887:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783969108.934889:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783969108.935283:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1783969108.935679:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1783969108.935698:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1783969108.935727:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1783969108.935737:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783969108.935740:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783969108.936014:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1783969108.936223:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1783969108.936245:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1783969108.936260:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1783969108.936272:0:6516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969108.936275:0:6516:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1783969108.936279:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783969108.936281:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783969108.936286:0:6516:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783969108.936291:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1783969108.936660:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1783969108.936763:0:6516:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783969108.953259:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1783969108.953294:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1783969108.953308:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1783969108.953326:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783969108.953348:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953365:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953375:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953424:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953432:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953439:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953446:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006fe03e11 already unused, calling callback (00000000fc97f683) 00010000:00010000:1.0:1783969108.953450:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953458:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953471:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953479:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.953486:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006fe03e11/0xea31253a47cb95ef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783969108.953507:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783969108.962927:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:6498:x1870627099115776:12345-0@lo:253: Request processed in 32917us (33160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969108.962944:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969108.963135:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000402dcf52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099115776:0@lo:253: 10000000:01000000:3.0:1783969108.963151:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783969108.963155:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783969108.963156:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783969108.963158:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969108.963159:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1783969108.963160:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969108.963161:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969108.963162:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783969108.963163:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783969108.963164:0:6498:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783969108.963166:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969108.963167:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783969108.963187:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007963f961 from lustre-MDT0000 10000000:01000000:3.0:1783969108.963219:0:6498:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783969108.963222:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783969108.963226:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93eaa5b00000 10000000:01000000:3.0:1783969108.963230:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969108.963237:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93eaa5b00000 from 1 10000000:01000000:3.0:1783969108.963254:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783969108.963292:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969108.963302:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969108.963310:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969108.963326:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000402dcf52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099115904:0@lo:101: 00000100:00100000:3.0:1783969108.964769:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969108.964874:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000007e556b3b going to sleep for 11 seconds 00000100:00100000:0.0:1783969108.968679:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099115904 00000100:00100000:0.0:1783969108.968694:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099115904 00000100:00100000:0.0:1783969108.968754:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969108.968763:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff133b26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:6498:x1870627099115904:12345-0@lo:101: 00010000:00010000:0.0:1783969108.968781:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969108.968802:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb95f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969108.968850:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb95f6 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969108.968862:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb95f6 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969108.968870:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c504b71, rc 0) 00000100:00100000:0.0:1783969108.968970:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff133b26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:6498:x1870627099115904:12345-0@lo:101: Request processed in 209us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969108.968979:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969108.971010:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000402dcf52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099115904:0@lo:101: 00010000:00010000:1.0:1783969108.971037:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.971065:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969108.971159:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116032:0@lo:501: 00000100:00100000:1.0:1783969108.971211:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969108.971256:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018eb2b53 going to sleep for 11 seconds 00000100:00100000:0.0:1783969108.972297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099116032 00000100:00100000:0.0:1783969108.972306:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099116032 00000100:00100000:0.0:1783969108.972355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969108.972363:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf38152d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:6498:x1870627099116032:12345-0@lo:501: 00000100:00100000:0.0:1783969108.973000:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf38152d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:6498:x1870627099116032:12345-0@lo:501: Request processed in 544us (1695us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783969108.973011:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969108.973210:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116032:0@lo:501: 10000000:01000000:1.0:1783969108.973251:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783969108.973278:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.973287:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969108.973297:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ea912c9800 10000000:01000000:1.0:1783969108.973302:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783969108.973307:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93ea912c9800 10000000:01000000:1.0:1783969108.973309:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783969108.973312:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff93ea912c9800 from 1 10000000:01000000:1.0:1783969108.973315:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783969108.973347:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000006fe03e11/0xea31253a47cb9604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.973354:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000006fe03e11/0xea31253a47cb9604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.973362:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000006fe03e11/0xea31253a47cb9604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969108.973419:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116160:0@lo:101: 00000100:00100000:1.0:1783969108.973459:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969108.973492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099116160 00000100:00100000:1.0:1783969108.973494:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018eb2b53 going to sleep for 11 seconds 00000100:00100000:3.0:1783969108.973499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099116160 00000100:00100000:3.0:1783969108.973565:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969108.973573:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000887c9694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:6498:x1870627099116160:12345-0@lo:101: 00010000:00010000:3.0:1783969108.973583:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969108.973596:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d2fd451/0xea31253a47cb960b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9604 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969108.973615:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d2fd451/0xea31253a47cb960b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9604 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969108.973625:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d2fd451/0xea31253a47cb960b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9604 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969108.973633:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d2fd451, rc 0) 00000100:00100000:3.0:1783969108.973671:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000887c9694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+7:6498:x1870627099116160:12345-0@lo:101: Request processed in 99us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969108.973686:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969108.974281:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116160:0@lo:101: 00010000:00010000:1.0:1783969108.974298:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000006fe03e11/0xea31253a47cb9604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.974306:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000006fe03e11/0xea31253a47cb9604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969108.974318:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783969108.974334:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000006fe03e11/0xea31253a47cb9604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.974340:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000006fe03e11/0xea31253a47cb9604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969108.974345:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783969108.974349:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783969108.974354:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93ea912c9800 10000000:01000000:1.0:1783969108.974356:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783969108.974359:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783969108.974361:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783969108.974378:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.974402:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.974425:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969108.974439:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116288:0@lo:101: 00000100:00100000:1.0:1783969108.974478:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969108.974506:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018eb2b53 going to sleep for 11 seconds 00000100:00100000:0.0:1783969108.974516:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099116288 00000100:00100000:0.0:1783969108.974522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099116288 00000100:00100000:0.0:1783969108.974565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969108.974571:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cbc811b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+7:6498:x1870627099116288:12345-0@lo:101: 00010000:00010000:0.0:1783969108.974580:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969108.974589:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9612 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969108.974604:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9612 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969108.974612:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9612 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969108.974618:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e46eeb4f, rc 0) 00000100:00100000:0.0:1783969108.974653:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cbc811b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+8:6498:x1870627099116288:12345-0@lo:101: Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969108.974659:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783969108.974688:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116288:0@lo:101: 00010000:00010000:1.0:1783969108.974697:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969108.974703:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969108.974748:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116416:0@lo:501: 00000100:00100000:1.0:1783969108.974771:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969108.974793:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018eb2b53 going to sleep for 11 seconds 00000100:00100000:3.0:1783969108.974806:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099116416 00000100:00100000:3.0:1783969108.974812:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099116416 00000100:00100000:3.0:1783969108.974852:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969108.974858:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000614dc8f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+8:6498:x1870627099116416:12345-0@lo:501: 00000100:00100000:3.0:1783969108.974983:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000614dc8f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6498:x1870627099116416:12345-0@lo:501: Request processed in 126us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969108.974990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783969108.975023:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116416:0@lo:501: 00000100:00100000:1.0:1783969108.975047:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116544:0@lo:503: 00000100:00100000:1.0:1783969108.975084:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969108.975108:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018eb2b53 going to sleep for 11 seconds 00000100:00100000:2.0:1783969108.975164:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099116544 00000100:00100000:2.0:1783969108.975170:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099116544 00000100:00100000:2.0:1783969108.975203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969108.975208:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003567ed73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6498:x1870627099116544:12345-0@lo:503: 00000100:00100000:2.0:1783969108.975334:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003567ed73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6498:x1870627099116544:12345-0@lo:503: Request processed in 105us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969108.975341:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969108.975482:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116544:0@lo:503: 00000100:00100000:1.0:1783969108.976141:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:6543:1870627099116672:0@lo:502: 00000100:00100000:1.0:1783969108.976183:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969108.976214:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afa5a352 going to sleep for 11 seconds 00000100:00100000:0.0:1783969108.976269:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099116672 00000100:00100000:0.0:1783969108.976280:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099116672 00000100:00100000:0.0:1783969108.976315:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969108.976321:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066abc8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6543:x1870627099116672:12345-0@lo:502: 00000100:00100000:0.0:1783969108.976443:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066abc8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6543:x1870627099116672:12345-0@lo:502: Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969108.976450:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969108.976610:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:6543:1870627099116672:0@lo:502: 00000020:01000000:1.0:1783969108.976637:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969108.976647:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969108.976650:0:6543:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783969108.976654:0:6543:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783969108.976657:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783969108.976671:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000030a576d4) 00000020:00000080:1.0:1783969108.976687:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783969108.976691:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783969108.976774:0:6543:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783969108.976781:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cb9627 00000020:00000080:1.0:1783969108.977095:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783969108.977100:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969108.977104:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969108.977106:0:6543:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783969108.977109:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969108.977113:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969108.977114:0:6543:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783969108.977118:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783969108.977125:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f9ca1457) 00000020:00000080:1.0:1783969108.977135:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783969108.977139:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783969108.977141:0:6543:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783969108.977143:0:6543:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783969108.977149:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783969108.977208:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007963f961 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783969108.977221:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007a27510c) 00000020:00000080:1.0:1783969108.977229:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783969108.977277:0:6543:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783969108.977283:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cb963c 00000020:00000080:1.0:1783969108.977368:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783969108.977374:0:6543:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783969108.977413:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xea31253a47cb9643 00080000:01000000:1.0:1783969108.977419:0:6543:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783969108.977431:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cb964a 00080000:10000000:2.0:1783969108.978584:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1783969108.978737:0:6543:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1783969108.988334:0:6543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783969109.110006:0:6543:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783969109.110479:0:6543:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783969109.116262:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783969109.118447:0:6543:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783969109.121816:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000660237f4) 00000020:00000080:2.0:1783969109.121854:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783969109.121952:0:6543:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783969109.121960:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cb9658 00000020:00000080:3.0:1783969109.122981:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1783969109.123906:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1783969109.131680:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1783969109.134635:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1783969109.148931:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1783969109.153547:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1783969109.156741:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1783969109.160602:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xea31253a47cb965f 00000020:00000080:3.0:1783969109.165465:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783969109.165479:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969109.165485:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969109.165488:0:6543:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783969109.165491:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969109.165496:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969109.165497:0:6543:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783969109.165501:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783969109.165503:0:6543:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783969109.165505:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969109.165508:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969109.165509:0:6543:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783969109.165511:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969109.165515:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969109.165516:0:6543:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783969109.165521:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783969109.165584:0:6543:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1783969109.165641:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009615c17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:6543:1870627099116800:0@lo:502: 00000100:00100000:3.0:1783969109.165743:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969109.165781:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099116800 00000100:00100000:3.0:1783969109.165799:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a15d5b66 going to sleep for 11 seconds 00000100:00100000:2.0:1783969109.165799:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099116800 00000100:00100000:2.0:1783969109.165882:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969109.165895:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a1fe9f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6543:x1870627099116800:12345-0@lo:502: 00000100:00100000:2.0:1783969109.166118:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a1fe9f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6543:x1870627099116800:12345-0@lo:502: Request processed in 225us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969109.166127:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783969109.166173:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009615c17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:6543:1870627099116800:0@lo:502: 00000020:01000000:3.0:1783969109.166211:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969109.166216:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969109.166218:0:6543:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1783969109.166221:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783969109.166409:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783969109.166430:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783969109.166457:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969109.166468:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969109.166476:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93ea912c9800 from 1 10000000:01000000:1.0:1783969109.166479:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783969109.166506:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969109.166514:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969109.166523:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969109.166556:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116928:0@lo:101: 00000100:00100000:1.0:1783969109.166600:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969109.166625:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000001057ef36 going to sleep for 11 seconds 00000100:00100000:3.0:1783969109.166749:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099116928 00000100:00100000:3.0:1783969109.166756:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099116928 00000100:00100000:3.0:1783969109.166793:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969109.166800:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000930ba82a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6498:x1870627099116928:12345-0@lo:101: 00010000:00010000:3.0:1783969109.166813:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969109.166838:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9666 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.166863:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9666 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.166872:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9666 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.166881:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001eb7e97c, rc 0) 00000100:00100000:3.0:1783969109.166924:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000930ba82a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+10:6498:x1870627099116928:12345-0@lo:101: Request processed in 124us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969109.166931:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969109.167042:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099116928:0@lo:101: 00010000:00010000:1.0:1783969109.167065:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969109.167074:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969109.169283:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117056:0@lo:256: 00000100:00100000:1.0:1783969109.169360:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969109.169417:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000001057ef36 going to sleep for 11 seconds 00000100:00100000:2.0:1783969109.169591:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099117056 00000100:00100000:2.0:1783969109.169610:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099117056 00000100:00100000:2.0:1783969109.169713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969109.169726:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e9fd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+10:6498:x1870627099117056:12345-0@lo:256: 20000000:01000000:2.0:1783969109.169768:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783969109.169777:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783969109.169939:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e9fd10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+10:6498:x1870627099117056:12345-0@lo:256: Request processed in 216us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969109.169947:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969109.170220:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018411d03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117056:0@lo:256: 10000000:01000000:3.0:1783969109.170912:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969109.170944:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.171642:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969109.171652:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ea912c9800 from 1 10000000:01000000:3.0:1783969109.171655:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969109.171694:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.171700:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.171709:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969109.171729:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009615c17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117184:0@lo:101: 00000100:00100000:3.0:1783969109.171788:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969109.171847:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000069987d5 going to sleep for 11 seconds 00000100:00100000:0.0:1783969109.171892:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099117184 00000100:00100000:0.0:1783969109.171904:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099117184 00000100:00100000:0.0:1783969109.171981:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969109.171990:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004703941a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+10:6498:x1870627099117184:12345-0@lo:101: 00010000:00010000:0.0:1783969109.172008:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969109.172029:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9674 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.172058:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9674 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.172070:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9674 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.172080:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019d2d596, rc 0) 00000100:00100000:0.0:1783969109.172153:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004703941a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:6498:x1870627099117184:12345-0@lo:101: Request processed in 163us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969109.172160:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969109.172214:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009615c17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117184:0@lo:101: 00010000:00010000:1.0:1783969109.172232:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969109.172242:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969109.172308:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbb10b62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117312:0@lo:501: 00000100:00100000:1.0:1783969109.181634:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969109.181732:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000001057ef36 going to sleep for 11 seconds 00000100:00100000:2.0:1783969109.187431:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099117312 00000100:00100000:2.0:1783969109.187451:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099117312 00000100:00100000:2.0:1783969109.187523:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783969109.187544:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdf08cf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:6498:x1870627099117312:12345-0@lo:501: 00000100:00100000:2.0:1783969109.187761:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdf08cf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:6498:x1870627099117312:12345-0@lo:501: Request processed in 219us (6134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969109.187771:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969109.187992:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbb10b62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117312:0@lo:501: 00000100:00100000:1.0:1783969109.188048:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbb10b62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117440:0@lo:503: 00000100:00100000:1.0:1783969109.188116:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969109.188158:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000001057ef36 going to sleep for 11 seconds 00000100:00100000:3.0:1783969109.188327:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099117440 00000100:00100000:3.0:1783969109.188333:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099117440 00000100:00100000:3.0:1783969109.188368:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969109.188375:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007664a1ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:6498:x1870627099117440:12345-0@lo:503: 00000040:00080000:3.0:1783969109.188429:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969109.188477:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007664a1ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:6498:x1870627099117440:12345-0@lo:503: Request processed in 102us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969109.188484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783969109.188569:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbb10b62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117440:0@lo:503: 00000040:00080000:1.0:1783969109.189472:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1783969109.189639:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1783969109.189660:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969109.189683:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.189704:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969109.189753:0:6498:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783969109.189756:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ea912c9800 10000000:01000000:3.0:1783969109.189759:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ea912c9800 10000000:01000000:3.0:1783969109.189763:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969109.189769:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93ea912c9800 from 1 10000000:01000000:3.0:1783969109.189771:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969109.189800:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.189807:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.189816:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969109.189846:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117568:0@lo:101: 00000100:00100000:3.0:1783969109.189895:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969109.189931:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b5032648 going to sleep for 11 seconds 00000100:00100000:0.0:1783969109.190115:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099117568 00000100:00100000:0.0:1783969109.190129:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099117568 00000100:00100000:0.0:1783969109.190200:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783969109.190210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018001db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:6498:x1870627099117568:12345-0@lo:101: 00010000:00010000:0.0:1783969109.190229:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969109.190261:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9682 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.190296:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9682 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.190307:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9682 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.190318:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000151c9ed8, rc 0) 00000100:00100000:0.0:1783969109.190434:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018001db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6498:x1870627099117568:12345-0@lo:101: Request processed in 225us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969109.190442:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969109.190552:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117568:0@lo:101: 00010000:00010000:3.0:1783969109.190570:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.190581:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969109.190649:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117696:0@lo:501: 00000100:00100000:3.0:1783969109.198036:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969109.198105:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b5032648 going to sleep for 11 seconds 00000100:00100000:1.0:1783969109.198284:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099117696 00000100:00100000:1.0:1783969109.198299:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099117696 00000100:00100000:1.0:1783969109.198376:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783969109.198416:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040a71552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6498:x1870627099117696:12345-0@lo:501: 00000100:00100000:1.0:1783969109.198595:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040a71552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6498:x1870627099117696:12345-0@lo:501: Request processed in 181us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969109.198616:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969109.198632:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117696:0@lo:501: 00000100:00100000:3.0:1783969109.198680:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117824:0@lo:503: 00000100:00100000:3.0:1783969109.198725:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969109.198750:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b5032648 going to sleep for 11 seconds 00000100:00100000:0.0:1783969109.199216:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099117824 00000100:00100000:0.0:1783969109.199230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099117824 00000100:00100000:0.0:1783969109.199295:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969109.199306:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000424264ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6498:x1870627099117824:12345-0@lo:503: 00000100:00100000:0.0:1783969109.200621:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000424264ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6498:x1870627099117824:12345-0@lo:503: Request processed in 1310us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969109.200637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969109.200674:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099117824:0@lo:503: 00000100:00100000:3.0:1783969109.201646:0:6548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:6548:1870627099117952:0@lo:502: 00000100:00100000:3.0:1783969109.201718:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969109.201761:0:6548:0:(client.c:2702:ptlrpc_set_wait()) set 0000000056cd06cb going to sleep for 11 seconds 00000100:00100000:2.0:1783969109.201856:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099117952 00000100:00100000:2.0:1783969109.201865:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099117952 00000100:00100000:2.0:1783969109.201930:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783969109.201943:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099d303a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6548:x1870627099117952:12345-0@lo:502: 00000100:00100000:2.0:1783969109.202127:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099d303a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6548:x1870627099117952:12345-0@lo:502: Request processed in 187us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969109.202134:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969109.202149:0:6548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:6548:1870627099117952:0@lo:502: 00000020:01000004:3.0:1783969109.202204:0:6548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783969109.202229:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006e0f7e98) 00000020:00000080:3.0:1783969109.202248:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1783969109.202489:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007963f961 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783969109.202494:0:6548:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007963f961 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783969109.202496:0:6548:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007963f961 4 00010000:00080000:3.0:1783969109.202536:0:6548:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f4569cb0@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1783969109.204159:0:6548:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1783969109.204265:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783969109.204310:0:6548:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783969109.204324:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xea31253a47cb9697 00000100:00080000:3.0:1783969109.204334:0:6548:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969109.204338:0:6548:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f4569cb0 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969109.204417:0:6548:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007b34f087 x1870627099118080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969109.204455:0:6548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783969109.204754:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099118080:0@lo:38: 00000100:00100000:0.0:1783969109.204843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969109.205410:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099118080 00000100:00100000:3.0:1783969109.205418:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099118080 00000100:00100000:3.0:1783969109.205463:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969109.205469:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fff6a04f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099118080:12345-0@lo:38: 00000100:00100000:3.0:1783969109.205529:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fff6a04f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099118080:12345-0@lo:38: Request processed in 58us (687us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783969109.205536:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969109.205624:0:6548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000732894a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:6548:1870627099118208:0@lo:502: 00000100:00100000:3.0:1783969109.205666:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969109.205685:0:6548:0:(client.c:2702:ptlrpc_set_wait()) set 0000000056cd06cb going to sleep for 11 seconds 00000100:00100000:0.0:1783969109.205851:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969109.205860:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000f4569cb0 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783969109.205864:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783969109.205867:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b34f087 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099118080:0@lo:38: 00000100:00100000:0.0:1783969109.205893:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099118208 00000100:00100000:0.0:1783969109.205896:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099118208 00000100:00100000:0.0:1783969109.205943:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969109.205949:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035c003e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6548:x1870627099118208:12345-0@lo:502: 00000100:00100000:0.0:1783969109.206053:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035c003e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6548:x1870627099118208:12345-0@lo:502: Request processed in 103us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969109.206059:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783969109.206152:0:6548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000732894a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:6548:1870627099118208:0@lo:502: 00000040:00080000:3.0:1783969109.206175:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1783969109.206356:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1783969109.206410:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783969109.206426:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.206436:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783969109.206477:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783969109.206480:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783969109.206481:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969109.206482:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969109.206483:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969109.206484:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969109.206485:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783969109.206486:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783969109.206487:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969109.206488:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969109.206490:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969109.206491:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783969109.206495:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1783969109.206497:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783969109.206498:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783969109.206499:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969109.206500:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969109.206501:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969109.206502:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969109.206502:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783969109.206503:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783969109.206504:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969109.206509:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969109.206510:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969109.206510:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783969109.206523:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783969109.206531:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000081055596 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099118336:0@lo:253: 00000100:00100000:0.0:1783969109.206561:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969109.206579:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 000000000b10725d going to sleep for 11 seconds 00000100:00100000:3.0:1783969109.206697:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099118336 00000100:00100000:3.0:1783969109.206703:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099118336 00000100:00100000:3.0:1783969109.206733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783969109.206739:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d406b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6498:x1870627099118336:12345-0@lo:253: 20000000:01000000:3.0:1783969109.206759:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783969109.206773:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783969109.215867:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783969109.215893:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783969109.216015:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783969109.216020:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783969109.216041:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.216066:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9666 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.216074:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.216115:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9666 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969109.216130:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9666 expref: 12 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969109.216144:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c672c35c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099118464:0@lo:104: 00000100:00100000:3.0:1783969109.216181:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d406b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6498:x1870627099118336:12345-0@lo:253: Request processed in 9441us (9618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969109.216191:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969109.216195:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969109.216240:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099118464 00000100:00100000:0.0:1783969109.216245:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c8a3a604 going to sleep for 11 seconds 00000100:00100000:1.0:1783969109.216248:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099118464 00000100:00100000:0.0:1783969109.216288:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000081055596 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:6498:1870627099118336:0@lo:253: 00000100:00100000:1.0:1783969109.216296:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 10000000:01000000:0.0:1783969109.216300:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:1.0:1783969109.216303:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f80878a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6537:x1870627099118464:12345-0@lo:104: 00000020:01000004:0.0:1783969109.216303:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783969109.216305:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00010000:00010000:1.0:1783969109.216314:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783969109.216319:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969109.216320:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969109.216322:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969109.216323:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969109.216324:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783969109.216325:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783969109.216326:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969109.216328:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969109.216329:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969109.216331:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783969109.216345:0:6498:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783969109.216372:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969109.216376:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f80878a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6537:x1870627099118464:12345-0@lo:104: Request processed in 75us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969109.216402:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783969109.216409:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969109.216417:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.216431:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000019d07527 already unused, calling callback (000000006c6f1bb4) 10000000:00010000:3.0:1783969109.216434:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.216441:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969109.216446:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969109.216451:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969109.216487:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.216503:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969109.216519:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.216525:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 0000000019d07527/0xea31253a47cb9666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb966d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.216540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969109.216542:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969109.216544:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969109.216708:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000732894a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099118592:0@lo:103: 00000100:00100000:1.0:1783969109.216739:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969109.216873:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099118592 00000100:00100000:3.0:1783969109.216877:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099118592 00010000:00010000:3.0:1783969109.216895:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9666 expref: 12 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969109.216933:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969109.216950:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbb10b62 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:3647:x1870627099118592:12345-0@lo:103: 00010000:00010000:3.0:1783969109.216961:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969109.216966:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9666 expref: 12 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.216976:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9666 expref: 12 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.216991:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.216997:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783969109.217009:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000989900s 00010000:00010000:3.0:1783969109.217013:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.217019:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.217025:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.217031:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.217036:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001c0d98cb already unused, calling callback (00000000fc97f683) 00010000:00010000:3.0:1783969109.217039:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.217045:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.217060:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969109.217068:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969109.217099:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbb10b62 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:3647:x1870627099118592:12345-0@lo:103: Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969109.217105:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969109.217133:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000732894a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099118592:0@lo:103: 00010000:00010000:1.0:1783969109.217454:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001eb7e97c/0xea31253a47cb966d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9666 expref: 11 pid: 6514 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969109.217467:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c672c35c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099118464:0@lo:104: 00010000:00010000:1.0:1783969109.217479:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969109.217487:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969109.217492:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969109.217498:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001c0d98cb/0xea31253a47cb969e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1783969109.230786:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1783969109.231122:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1783969109.231752:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1783969109.231994:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1783969109.232195:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1783969109.232721:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1783969109.233609:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1783969109.233766:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1783969109.234309:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1783969109.234669:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1783969109.235694:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1783969109.240583:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1783969109.250359:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1783969109.263084:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783969109.263365:0:6553:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1783969109.263371:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783969109.264135:0:6554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783969109.266937:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783969109.267114:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783969109.267539:0:6498:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783969109.267547:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783969109.267645:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969109.268660:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783969109.270930:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783969109.270998:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783969109.271250:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783969109.271524:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1783969109.272255:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1783969109.272435:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1783969109.272617:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1783969109.272764:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1783969109.272930:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1783969109.273079:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1783969109.273239:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1783969109.273368:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1783969109.273541:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1783969109.273680:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000040:00080000:2.0:1783969109.273910:0:6554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1783969109.275447:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1783969109.281742:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1783969109.282751:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1783969109.282940:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1783969109.283335:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1783969109.283515:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1783969109.283827:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1783969109.285658:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1783969109.286023:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1783969109.286413:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1783969109.290340:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1783969109.292727:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1783969109.293351:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1783969109.294018:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783969109.294473:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1783969109.294707:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1783969109.294868:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783969109.297712:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1783969109.298476:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783969109.300167:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783969109.302469:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00000040:00080000:2.0:1783969109.303096:0:6554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783969109.303179:0:6554:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783969109.303184:0:6554:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1783969109.304787:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783969109.305230:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1783969109.308810:0:6498:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783969109.308861:0:6498:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafc3c1c33988 00100000:10000000:0.0:1783969109.308870:0:6498:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1783969109.316579:0:6498:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783969109.316597:0:6498:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783969109.316617:0:6498:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1783969109.317930:0:6498:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1783969109.318690:0:6498:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969109.318900:0:6498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783969109.811202:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969110.834426:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969111.862595:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969112.890445:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969113.907761:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783969114.191699:0:6799:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1783969114.483057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783969114.483067:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783969114.483070:0:8:0:(import.c:65:import_set_state_nolock()) 00000000f4569cb0 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969114.483083:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f4569cb0 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969114.483104:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b56cc5e4 x1870627099118848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783969114.483139:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b56cc5e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099118848:0@lo:38: 00000100:00100000:1.0:1783969114.483413:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000732894a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099118720:0@lo:400: 00000100:00100000:1.0:1783969114.483453:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969114.483586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969114.483644:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099118720 00000100:00100000:3.0:1783969114.483652:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099118720 00000100:00100000:3.0:1783969114.483698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969114.483706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c8c13df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:3648:x1870627099118720:12345-0@lo:400: 00000100:00100000:3.0:1783969114.483768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c8c13df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:3648:x1870627099118720:12345-0@lo:400: Request processed in 63us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969114.483777:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783969114.484011:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099118848 00000100:00100000:1.0:1783969114.484016:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099118848 00000100:00100000:1.0:1783969114.484040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969114.484044:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aeab8bba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1870627099118848:12345-0@lo:38: 00010000:00080000:1.0:1783969114.484064:0:6523:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:1.0:1783969114.484098:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xea31253a47cb96a5 00000004:00100000:1.0:1783969114.484138:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783969114.484241:0:6523:0:(import.c:65:import_set_state_nolock()) 0000000000183382 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969114.484297:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aeab8bba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870627099118848:12345-0@lo:38: Request processed in 251us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969114.484303:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783969114.484614:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b56cc5e4 x1870627099118848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783969114.484629:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783969114.489272:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783969114.489302:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783969114.489307:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000f4569cb0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783969114.489319:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b56cc5e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099118848:0@lo:38: 00000100:00100000:3.0:1783969114.489407:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000732894a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099118720:0@lo:400: 00010000:00010000:1.0:1783969114.929407:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783969115.063148:0:6851:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783969115.063313:0:6851:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783969115.953741:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783969116.528715:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783969116.528723:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93ea912c9800 from 3 10000000:01000000:1.0:1783969116.528727:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783969116.528774:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969116.528787:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969116.528796:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969116.528836:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c1af0030 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099118976:0@lo:101: 00000100:00100000:1.0:1783969116.528918:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969116.528990:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000089208470 going to sleep for 11 seconds 00000100:00100000:3.0:1783969116.529183:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099118976 00000100:00100000:3.0:1783969116.529192:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099118976 00000100:00100000:3.0:1783969116.529247:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969116.529254:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f60e8549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:6518:x1870627099118976:12345-0@lo:101: 00010000:00010000:3.0:1783969116.529267:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969116.529280:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb96ac expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969116.529302:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb96ac expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969116.529311:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb96ac expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969116.529327:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007380d9a4, rc 0) 00000100:00100000:3.0:1783969116.529408:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f60e8549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6518:x1870627099118976:12345-0@lo:101: Request processed in 154us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969116.529414:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783969116.531004:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c1af0030 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099118976:0@lo:101: 00010000:00010000:2.0:1783969116.531028:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969116.531039:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969116.531114:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000cf421eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099119104:0@lo:256: 00000100:00100000:2.0:1783969116.531166:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969116.531210:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000007256eaf7 going to sleep for 11 seconds 00000100:00100000:3.0:1783969116.531892:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099119104 00000100:00100000:3.0:1783969116.531900:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099119104 00000100:00100000:3.0:1783969116.531956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969116.531964:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000951644e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6518:x1870627099119104:12345-0@lo:256: 20000000:01000000:3.0:1783969116.531984:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783969116.532003:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783969116.532007:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783969116.532104:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000951644e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:6518:x1870627099119104:12345-0@lo:256: Request processed in 141us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969116.532112:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783969116.532316:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000cf421eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099119104:0@lo:256: 10000000:01000000:2.0:1783969116.532365:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783969116.532423:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969116.532431:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969116.978039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969118.001033:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783969118.411902:0:6952:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969118.412204:0:6952:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783969119.027131:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969119.603726:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969119.603762:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b56cc5e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099119360:0@lo:400: 00000100:00100000:3.0:1783969119.603832:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969119.603914:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099119360 00000100:00100000:3.0:1783969119.603922:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099119360 00000100:00100000:3.0:1783969119.603965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969119.603973:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008c12343 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099119360:12345-0@lo:400: 00000100:00100000:3.0:1783969119.604023:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008c12343 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099119360:12345-0@lo:400: Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969119.604030:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783969119.604064:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b56cc5e4 x1870627099119360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969119.604096:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b56cc5e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099119360:0@lo:400: 00000100:00100000:0.0:1783969119.604347:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969119.604357:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000732894a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099119232:0@lo:400: 00000100:00100000:0.0:1783969119.604435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969119.604664:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099119232 00000100:00100000:3.0:1783969119.604670:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099119232 00000100:00100000:3.0:1783969119.604706:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969119.604713:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e93079c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:3648:x1870627099119232:12345-0@lo:400: 00000100:00100000:3.0:1783969119.604914:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e93079c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:3648:x1870627099119232:12345-0@lo:400: Request processed in 202us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969119.604921:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969119.604996:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000732894a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099119232:0@lo:400: 00010000:00010000:2.0:1783969120.049534:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969121.072594:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969122.098168:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969123.120536:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969124.144504:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969124.720724:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000cf421eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099119488:0@lo:400: 00000100:00100000:2.0:1783969124.720827:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2297981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099119616:0@lo:400: 00000100:00100000:0.0:1783969124.720876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969124.722693:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099119488 00000100:00100000:0.0:1783969124.722705:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099119488 00000100:00100000:0.0:1783969124.722834:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783969124.722845:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afa79334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:3647:x1870627099119488:12345-0@lo:400: 00000100:00100000:2.0:1783969124.727193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969124.729345:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afa79334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:3647:x1870627099119488:12345-0@lo:400: Request processed in 6474us (8442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969124.729363:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969124.734028:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099119616 00000100:00100000:1.0:1783969124.734050:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099119616 00000100:00100000:1.0:1783969124.734325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969124.734338:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d55bb8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099119616:12345-0@lo:400: 00000100:00100000:2.0:1783969124.734374:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000cf421eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099119488:0@lo:400: 00000100:00100000:1.0:1783969124.735421:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d55bb8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099119616:12345-0@lo:400: Request processed in 1082us (8233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969124.735434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783969124.736847:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d2297981 x1870627099119616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969124.736891:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2297981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099119616:0@lo:400: 00010000:00010000:3.0:1783969125.173244:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969126.199941:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969127.217116:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969128.242193:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783969128.812204:0:7451:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783969128.812209:0:7451:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783969128.812211:0:7451:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783969128.813931:0:7451:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000076b0ffbd 00000020:01000004:0.0:1783969128.813954:0:7451:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1783969128.813967:0:7451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783969128.813980:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000d5b4a08a) 00000020:00000080:0.0:1783969128.813998:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783969128.906935:0:7451:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1783969128.907006:0:7451:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1783969128.945968:0:7451:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783969128.946176:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1783969128.946190:0:7451:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783969128.946202:0:7451:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cb96c1 00000020:01000004:1.0:1783969128.946209:0:7451:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783969128.946230:0:7451:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783969128.946233:0:7451:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783969128.946239:0:7451:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1783969128.946280:0:7451:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1783969128.946284:0:7451:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1783969128.976139:0:7451:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783969128.976182:0:7451:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1783969128.976186:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783969128.976188:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783969128.976189:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969128.976190:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969128.976192:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969128.976193:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969128.976194:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783969128.976196:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783969128.976197:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783969128.976198:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969128.976199:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783969128.976203:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1783969128.976205:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783969128.976206:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783969128.976207:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969128.976209:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969128.976209:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969128.976211:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969128.976211:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783969128.976212:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783969128.976213:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783969128.976214:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969128.976215:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783969128.976241:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1783969128.976260:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009b4e44b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099119744:0@lo:253: 00000100:00100000:1.0:1783969128.976345:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969128.976423:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000505784c3 going to sleep for 11 seconds 00000100:00100000:3.0:1783969128.976965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099119744 00000100:00100000:3.0:1783969128.976974:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099119744 00000100:00100000:3.0:1783969128.977035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969128.977044:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056f6c656 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099119744:12345-0@lo:253: 20000000:01000000:3.0:1783969128.977078:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783969128.977083:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1783969128.977088:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1783969128.977092:0:6514:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1783969128.977134:0:6514:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1783969128.977376:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969128.977556:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1783969128.977571:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783969128.977589:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1783969128.977606:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1783969128.977620:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1783969128.977685:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1783969128.977693:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1783969128.977707:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1783969128.977712:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1783969128.977725:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1783969128.977731:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1783969128.977743:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1783969128.977756:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1783969128.977859:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1783969128.977869:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:3.0:1783969128.977883:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1783969128.977888:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783969128.977900:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1783969128.977906:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:3.0:1783969128.977917:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1783969128.977922:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1783969128.977934:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1783969128.977950:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1783969128.977961:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1783969128.978043:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1783969128.978052:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1783969128.978067:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1783969128.978084:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1783969128.978097:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1783969128.978102:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1783969128.978112:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1783969128.978129:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1783969128.978134:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1783969128.978156:0:6514:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1783969128.978164:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1783969128.979191:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1783969128.979442:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1783969128.979466:0:6514:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.134@tcp for mdt 20000000:01000000:0.0:1783969128.979468:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:0.0:1783969128.979485:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1783969128.979493:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783969128.979517:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1783969128.979524:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:0.0:1783969128.979541:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1783969128.979549:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1783969128.979563:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1783969128.979582:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1783969128.979636:0:6514:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1783969128.979644:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1783969128.981979:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1783969128.982244:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1783969128.982345:0:6514:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.201.134@tcp for mdt 20000000:01000000:0.0:1783969128.982349:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:0.0:1783969128.982369:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1783969128.982376:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783969128.982788:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1783969128.982797:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:0.0:1783969128.982828:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1783969128.982837:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1783969128.982851:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1783969128.982868:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1783969128.982893:0:6514:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783969128.982896:0:6514:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783969128.982899:0:6514:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783969128.982945:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783969128.982947:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783969128.983247:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1783969128.983347:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1783969128.983365:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1783969128.983716:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1783969128.983738:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1783969128.983752:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1783969128.983760:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783969128.983762:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783969128.984075:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1783969128.984095:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1783969128.984108:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1783969128.984230:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1783969128.984247:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1783969128.984360:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1783969128.984371:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783969128.984373:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783969128.984896:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1783969128.984931:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1783969128.984944:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1783969128.985084:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1783969128.985104:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1783969128.985128:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1783969128.985143:0:6514:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783969128.985145:0:6514:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783969128.985150:0:6514:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783969128.985156:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1783969128.987213:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1783969128.987556:0:6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783969128.999533:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783969128.999774:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969128.999796:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb95f6 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969128.999802:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9612 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969128.999828:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9682 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969128.999835:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969128.999881:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9682 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969128.999897:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9682 expref: 12 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969128.999913:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007acfab8c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1870627099119872:0@lo:104: 00000100:00100000:1.0:1783969128.999983:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969129.000088:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9612 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.000095:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9612 expref: 12 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969129.000103:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000387b930 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1870627099120000:0@lo:104: 00000100:00100000:1.0:1783969129.000125:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969129.000243:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb95f6 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.000252:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb95f6 expref: 12 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969129.000270:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009017bf7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1870627099120128:0@lo:104: 00000100:00100000:1.0:1783969129.000299:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.000523:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099119872 00000100:00100000:0.0:1783969129.000537:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099119872 00000100:00100000:0.0:1783969129.000595:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099120000 00000100:00100000:0.0:1783969129.000599:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099120000 00000100:00100000:0.0:1783969129.000614:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969129.000621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbb8888b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6514:x1870627099119872:12345-0@lo:104: 00010000:00010000:0.0:1783969129.000634:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.000685:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969129.000690:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbb8888b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6514:x1870627099119872:12345-0@lo:104: Request processed in 70us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969129.000697:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969129.000714:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969129.000719:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd012cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6514:x1870627099120000:12345-0@lo:104: 00010000:00010000:0.0:1783969129.000726:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.000757:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969129.000762:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd012cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6514:x1870627099120000:12345-0@lo:104: Request processed in 44us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969129.000768:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969129.001360:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b3621c3 going to sleep for 10 seconds 00000100:00100000:3.0:1783969129.001449:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099120128 00000100:00100000:3.0:1783969129.001455:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099120128 00000100:00100000:3.0:1783969129.001485:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969129.001491:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3b06a56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6514:x1870627099120128:12345-0@lo:104: 00010000:00010000:3.0:1783969129.001510:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969129.001728:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007acfab8c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1870627099119872:0@lo:104: 00010000:00010000:3.0:1783969129.001756:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783969129.001761:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3b06a56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6514:x1870627099120128:12345-0@lo:104: Request processed in 271us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969129.001769:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783969129.001788:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783969129.001793:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.001801:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c55a4c33 already unused, calling callback (000000006c6f1bb4) 10000000:00010000:3.0:1783969129.001804:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.001828:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969129.001834:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969129.001840:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969129.001880:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.001887:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969129.001917:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.001924:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb9682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9689 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.001936:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969129.001938:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.001943:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000053a8d030 already unused, calling callback (000000006c6f1bb4) 10000000:00010000:3.0:1783969129.001945:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.001951:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969129.001956:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969129.001969:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969129.001983:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.001989:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969129.002005:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.002012:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb9612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9619 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.002020:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969129.002023:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.002028:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000afa81da2 already unused, calling callback (000000006c6f1bb4) 10000000:00010000:3.0:1783969129.002030:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.002036:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969129.002041:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969129.002046:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969129.002057:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.002063:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969129.002073:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.002078:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb95f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb95fd expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.002091:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969129.002092:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969129.002093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969129.002100:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969129.002191:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b56cc5e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099120256:0@lo:103: 00000100:00100000:1.0:1783969129.002412:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000387b930 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1870627099120000:0@lo:104: 00000100:00100000:1.0:1783969129.002424:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009017bf7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1870627099120128:0@lo:104: 00010000:00010000:1.0:1783969129.002446:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969129.002558:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8771818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099120384:0@lo:103: 00000100:00100000:3.0:1783969129.002610:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969129.002648:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969129.002653:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099120512:0@lo:103: 00000100:00100000:3.0:1783969129.002674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969129.002791:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099120384 00000100:00100000:1.0:1783969129.002796:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099120384 00010000:00010000:1.0:1783969129.002815:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9612 expref: 13 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969129.002881:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099120512 00000100:00100000:1.0:1783969129.002885:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099120512 00010000:00010000:1.0:1783969129.002896:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb95f6 expref: 14 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969129.002909:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969129.002915:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3217b1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:3646:x1870627099120384:12345-0@lo:103: 00010000:00010000:1.0:1783969129.002927:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969129.002931:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9612 expref: 14 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.002940:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9612 expref: 14 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.002952:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb9619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9612 expref: 14 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.002977:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969129.003005:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3217b1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:3646:x1870627099120384:12345-0@lo:103: Request processed in 91us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.003012:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969129.003026:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969129.003031:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004611d77f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:3646:x1870627099120512:12345-0@lo:103: 00010000:00010000:1.0:1783969129.003038:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969129.003041:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb95f6 expref: 12 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003048:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb95f6 expref: 12 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003057:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c504b71/0xea31253a47cb95fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb95f6 expref: 12 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003065:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969129.003085:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004611d77f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:3646:x1870627099120512:12345-0@lo:103: Request processed in 54us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.003092:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969129.003206:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099120512:0@lo:103: 00000100:00100000:3.0:1783969129.003215:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8771818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099120384:0@lo:103: 00000100:00100000:2.0:1783969129.003688:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969129.003796:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099120256 00000100:00100000:1.0:1783969129.003801:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099120256 00010000:00010000:1.0:1783969129.003819:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9682 expref: 11 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969129.003884:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969129.003891:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cf421eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:3649:x1870627099120256:12345-0@lo:103: 00010000:00010000:1.0:1783969129.003899:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969129.003910:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9682 expref: 11 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003919:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9682 expref: 11 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003928:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000151c9ed8/0xea31253a47cb9689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9682 expref: 11 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003939:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003946:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003959:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003965:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003970:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003975:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003981:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000064b4683f already unused, calling callback (00000000fc97f683) 00010000:00010000:1.0:1783969129.003984:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.003990:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.004017:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.004027:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969129.004064:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cf421eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+10:3649:x1870627099120256:12345-0@lo:103: Request processed in 174us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.004071:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969129.004127:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b56cc5e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099120256:0@lo:103: 00010000:00010000:3.0:1783969129.004178:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.004186:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.004192:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000064b4683f/0xea31253a47cb96c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783969129.004208:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1783969129.006521:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056f6c656 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:7451:x1870627099119744:12345-0@lo:253: Request processed in 29472us (30170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969129.006548:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969129.006622:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009b4e44b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099119744:0@lo:253: 10000000:01000000:1.0:1783969129.006635:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783969129.006638:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783969129.006640:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783969129.006641:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969129.006642:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1783969129.006643:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969129.006644:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969129.006646:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783969129.006647:0:7451:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783969129.006649:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969129.006650:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783969129.006670:0:7451:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000076b0ffbd from lustre-MDT0001 10000000:01000000:1.0:1783969129.006698:0:7451:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1783969129.006701:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1783969129.006708:0:7451:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93eaa5b00000 local copy 10000000:01000000:1.0:1783969129.006711:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783969129.006743:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.006753:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.006761:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969129.006790:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009b4e44b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099120640:0@lo:101: 00000100:00100000:1.0:1783969129.006837:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969129.006917:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000005d56ae7d going to sleep for 11 seconds 00000100:00100000:0.0:1783969129.006956:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099120640 00000100:00100000:0.0:1783969129.006962:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099120640 00000100:00100000:0.0:1783969129.007331:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783969129.007340:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b1f179b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:7451:x1870627099120640:12345-0@lo:101: 00010000:00010000:0.0:1783969129.007354:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969129.007366:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000083d62dd6/0xea31253a47cb96d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb96cf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.007529:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083d62dd6/0xea31253a47cb96d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb96cf expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.007538:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000083d62dd6/0xea31253a47cb96d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb96cf expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.007546:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000083d62dd6, rc 0) 00000100:00100000:0.0:1783969129.007630:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b1f179b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+10:7451:x1870627099120640:12345-0@lo:101: Request processed in 291us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969129.007636:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969129.007833:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009b4e44b pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099120640:0@lo:101: 00010000:00010000:3.0:1783969129.007847:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.007856:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969129.007951:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8771818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099120768:0@lo:501: 00000100:00100000:3.0:1783969129.007980:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969129.008010:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005b825e5 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.008051:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099120768 00000100:00100000:1.0:1783969129.008056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099120768 00000100:00100000:1.0:1783969129.008128:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783969129.008135:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006875aaa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+10:7451:x1870627099120768:12345-0@lo:501: 00000100:00100000:1.0:1783969129.008199:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006875aaa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+10:7451:x1870627099120768:12345-0@lo:501: Request processed in 66us (219us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783969129.008205:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969129.008334:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8771818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099120768:0@lo:501: 10000000:01000000:3.0:1783969129.008346:0:7451:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783969129.008363:0:7451:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783969129.008367:0:7451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.008374:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.008447:0:7451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.008700:0:7451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783969129.008727:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93eab929d800 10000000:01000000:2.0:1783969129.008732:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783969129.008737:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93eaa5b00000 10000000:01000000:2.0:1783969129.008740:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783969129.008743:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff93eaa5b00000 from 1 10000000:01000000:2.0:1783969129.008745:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783969129.008769:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000005f7e0576/0xea31253a47cb96dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.008776:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000005f7e0576/0xea31253a47cb96dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.008783:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000005f7e0576/0xea31253a47cb96dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969129.008797:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099120896:0@lo:101: 00000100:00100000:2.0:1783969129.008828:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.008854:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fade6b2 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.008896:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099120896 00000100:00100000:1.0:1783969129.008901:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099120896 00000100:00100000:1.0:1783969129.008932:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783969129.008939:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dabebb87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+10:7451:x1870627099120896:12345-0@lo:101: 00010000:00010000:1.0:1783969129.008948:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969129.008958:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009926d4c6/0xea31253a47cb96e4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb96dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.008972:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009926d4c6/0xea31253a47cb96e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb96dd expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.008980:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009926d4c6/0xea31253a47cb96e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb96dd expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.008987:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009926d4c6, rc 0) 00000100:00100000:1.0:1783969129.009014:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dabebb87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:7451:x1870627099120896:12345-0@lo:101: Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.009033:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783969129.009103:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099120896:0@lo:101: 00010000:00010000:2.0:1783969129.009114:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000005f7e0576/0xea31253a47cb96dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96e4 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009121:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000005f7e0576/0xea31253a47cb96dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb96e4 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969129.009149:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783969129.009166:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000005f7e0576/0xea31253a47cb96dd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96e4 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009173:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000005f7e0576/0xea31253a47cb96dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96e4 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969129.009180:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93eab929d800 10000000:01000000:2.0:1783969129.009184:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783969129.009187:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff93eab929d800 from 1 10000000:01000000:2.0:1783969129.009188:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783969129.009201:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000038a74342/0xea31253a47cb96eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009207:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000038a74342/0xea31253a47cb96eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009213:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000038a74342/0xea31253a47cb96eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969129.009223:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121024:0@lo:101: 00000100:00100000:2.0:1783969129.009246:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.009407:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099121024 00000100:00100000:2.0:1783969129.009412:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099121024 00000100:00100000:2.0:1783969129.009436:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783969129.009442:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fc35a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+11:7451:x1870627099121024:12345-0@lo:101: 00010000:00010000:2.0:1783969129.009449:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969129.009459:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2d304dc/0xea31253a47cb96f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb96eb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009479:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2d304dc/0xea31253a47cb96f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb96eb expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009486:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2d304dc/0xea31253a47cb96f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb96eb expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009492:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2d304dc, rc 0) 00000100:00100000:2.0:1783969129.009525:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fc35a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099121024:12345-0@lo:101: Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.009531:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783969129.009556:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fade6b2 going to sleep for 11 seconds 00000100:00100000:2.0:1783969129.009568:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121024:0@lo:101: 00010000:00010000:2.0:1783969129.009577:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000038a74342/0xea31253a47cb96eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009583:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000038a74342/0xea31253a47cb96eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969129.009594:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783969129.009603:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000038a74342/0xea31253a47cb96eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009608:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000038a74342/0xea31253a47cb96eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969129.009614:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783969129.009626:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783969129.009645:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93eab929d800 10000000:01000000:2.0:1783969129.009732:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783969129.009736:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1783969129.009738:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783969129.009753:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000c1b09ce9/0xea31253a47cb96f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009760:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000c1b09ce9/0xea31253a47cb96f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009766:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000c1b09ce9/0xea31253a47cb96f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969129.009777:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121152:0@lo:101: 00000100:00100000:2.0:1783969129.009802:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.009822:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099121152 00000100:00100000:2.0:1783969129.009826:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099121152 00000100:00100000:2.0:1783969129.009848:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783969129.009853:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fdea7fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099121152:12345-0@lo:101: 00010000:00010000:2.0:1783969129.009861:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969129.009868:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da3cc4f9/0xea31253a47cb9700 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb96f9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009879:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da3cc4f9/0xea31253a47cb9700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb96f9 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009886:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da3cc4f9/0xea31253a47cb9700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb96f9 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009892:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da3cc4f9, rc 0) 00000100:00100000:2.0:1783969129.009915:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fdea7fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:7451:x1870627099121152:12345-0@lo:101: Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.009926:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783969129.009950:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fade6b2 going to sleep for 11 seconds 00000100:00100000:2.0:1783969129.009962:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121152:0@lo:101: 00010000:00010000:2.0:1783969129.009971:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000c1b09ce9/0xea31253a47cb96f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.009977:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000c1b09ce9/0xea31253a47cb96f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969129.010050:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121280:0@lo:501: 00000100:00100000:2.0:1783969129.010075:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.010092:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099121280 00000100:00100000:2.0:1783969129.010096:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099121280 00000100:00100000:2.0:1783969129.010122:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783969129.010126:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086c416e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:7451:x1870627099121280:12345-0@lo:501: 00000100:00100000:2.0:1783969129.010748:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086c416e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:7451:x1870627099121280:12345-0@lo:501: Request processed in 620us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.010756:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783969129.010794:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fade6b2 going to sleep for 11 seconds 00000100:00100000:2.0:1783969129.010809:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121280:0@lo:501: 00000100:00100000:2.0:1783969129.010836:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121408:0@lo:503: 00000100:00100000:2.0:1783969129.010879:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969129.010963:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969129.010969:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.010977:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb58781f already unused, calling callback (000000006c6f1bb4) 10000000:00010000:0.0:1783969129.010980:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.010988:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969129.010994:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969129.010999:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969129.011018:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.011024:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969129.011052:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.011058:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000eb58781f/0xea31253a47cb96cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea31253a47cb96d6 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.011074:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969129.011076:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969129.011077:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969129.011085:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969129.011096:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000081055596 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099121536:0@lo:103: 00000100:00100000:0.0:1783969129.011124:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.011181:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8f0af7f going to sleep for 11 seconds 00000100:00100000:3.0:1783969129.011341:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099121536 00000100:00100000:3.0:1783969129.011346:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099121536 00000100:00100000:3.0:1783969129.011435:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969129.011443:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030e31596 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:3649:x1870627099121536:12345-0@lo:103: 00010000:00010000:3.0:1783969129.011461:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969129.011473:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000083d62dd6/0xea31253a47cb96d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb96cf expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.011486:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969129.011924:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030e31596 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:3649:x1870627099121536:12345-0@lo:103: Request processed in 482us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969129.011932:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969129.012006:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000081055596 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099121536:0@lo:103: 00000100:00100000:1.0:1783969129.012079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099121408 00000100:00100000:1.0:1783969129.012084:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099121408 00000100:00100000:1.0:1783969129.012119:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783969129.012125:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007594a119 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099121408:12345-0@lo:503: 00000100:00100000:1.0:1783969129.012230:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007594a119 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099121408:12345-0@lo:503: Request processed in 105us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.012237:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783969129.012409:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121408:0@lo:503: 00000040:00080000:2.0:1783969129.012702:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783969129.012781:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121664:0@lo:502: 00000100:00100000:2.0:1783969129.012827:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.012858:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8f0af7f going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.012949:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099121664 00000100:00100000:1.0:1783969129.012953:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099121664 00000100:00100000:1.0:1783969129.012979:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783969129.012984:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001084ea3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099121664:12345-0@lo:502: 00000100:00100000:1.0:1783969129.013060:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001084ea3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099121664:12345-0@lo:502: Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.013067:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783969129.013146:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121664:0@lo:502: 00000040:00080000:2.0:1783969129.013434:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783969129.013463:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1783969129.013477:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1783969129.013490:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1783969129.013518:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1783969129.013530:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1783969129.013541:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1783969129.013553:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1783969129.013564:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1783969129.013575:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1783969129.013588:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1783969129.013602:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1783969129.013616:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1783969129.013629:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1783969129.013645:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1783969129.013677:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1783969129.013690:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1783969129.013702:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1783969129.013714:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1783969129.013726:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1783969129.013739:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1783969129.013751:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1783969129.013762:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1783969129.013785:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121792:0@lo:502: 00000100:00100000:2.0:1783969129.013840:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.013878:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8f0af7f going to sleep for 11 seconds 00000100:00100000:2.0:1783969129.013897:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099121792 00000100:00100000:2.0:1783969129.013901:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099121792 00000100:00100000:2.0:1783969129.013923:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783969129.013927:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000038f50c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099121792:12345-0@lo:502: 00000100:00100000:2.0:1783969129.013993:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000038f50c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099121792:12345-0@lo:502: Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.013998:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783969129.014024:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099121792:0@lo:502: 00000040:00080000:2.0:1783969129.014051:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1783969129.014056:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1783969129.014849:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969129.014859:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969129.014861:0:7463:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783969129.014865:0:7463:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1783969129.014867:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969129.014878:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000a653a15c) 00000020:00000080:0.0:1783969129.014901:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1783969129.014905:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783969129.014966:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783969129.014970:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cb970e 00000020:00000080:0.0:1783969129.015135:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783969129.015138:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969129.015141:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969129.015142:0:7463:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783969129.015144:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969129.015146:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969129.015147:0:7463:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1783969129.015149:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969129.015159:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000b3351392) 00000020:00000080:0.0:1783969129.015168:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1783969129.015174:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783969129.015175:0:7463:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1783969129.015177:0:7463:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1783969129.015181:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783969129.015212:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000076b0ffbd from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783969129.015220:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000b93c05c0) 00000020:00000080:0.0:1783969129.015225:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1783969129.015332:0:7463:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783969129.015337:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cb9723 00000020:00000080:0.0:1783969129.015531:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1783969129.015537:0:7463:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783969129.015542:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xea31253a47cb972a 00080000:01000000:0.0:1783969129.015547:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783969129.015550:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cb9731 00080000:10000000:0.0:1783969129.015906:0:7463:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1783969129.015994:0:7463:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1783969129.123870:0:7463:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1783969129.124539:0:7463:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1783969129.131037:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783969129.134880:0:7463:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783969129.166214:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1783969129.166227:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969129.166233:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969129.166235:0:7463:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1783969129.166238:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969129.166244:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969129.166245:0:7463:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1783969129.166248:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783969129.166262:0:7463:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:00000080:2.0:1783969129.166286:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783969129.166299:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000034152820) 00000020:00000080:2.0:1783969129.166320:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1783969129.166324:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783969129.166408:0:7463:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1783969129.166414:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783969129.166425:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cb973f 00010000:00080000:2.0:1783969129.166454:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000057228922@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1783969129.168627:0:7463:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1783969129.187374:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783969129.187421:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783969129.187474:0:7463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783969129.187511:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cb9746 00000100:00080000:1.0:1783969129.187523:0:7463:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783969129.187529:0:7463:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000057228922 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969129.187570:0:7463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000009017bf7 x1870627099121920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783969129.188818:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009017bf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099121920:0@lo:38: 00000100:00100000:3.0:1783969129.188946:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.189047:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099121920 00000100:00100000:2.0:1783969129.189055:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099121920 00000100:00100000:2.0:1783969129.189114:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969129.189121:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8771818 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099121920:12345-0@lo:38: 00010000:00080000:2.0:1783969129.189149:0:6526:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1783969129.189185:0:6526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cb974d 00000004:00100000:2.0:1783969129.189200:0:6526:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783969129.189206:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1783969129.190826:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1783969129.190942:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969129.190950:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969129.190952:0:7463:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1783969129.190970:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783969129.190973:0:7463:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1783969129.190974:0:7463:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783969129.190975:0:7463:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783969129.190977:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783969129.190979:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969129.190980:0:7463:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783969129.190982:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969129.190988:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969129.190989:0:7463:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1783969129.190993:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783969129.191044:0:7463:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783969129.191056:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969129.191060:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969129.191061:0:7463:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1783969129.191064:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969129.191066:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969129.191069:0:7463:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783969129.191071:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783969129.191072:0:7463:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783969129.191099:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969129.191102:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969129.191103:0:7463:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783969129.191106:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1783969129.191674:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1783969129.191711:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783969129.191726:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000c1b09ce9/0xea31253a47cb96f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.191738:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000c1b09ce9/0xea31253a47cb96f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969129.191745:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93eab929d800 from 1 10000000:01000000:2.0:1783969129.191748:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783969129.191773:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.191781:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.191790:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969129.191821:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a5e7f519 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122176:0@lo:101: 00000100:00100000:2.0:1783969129.191883:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.191919:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8f0af7f going to sleep for 11 seconds 00000100:00100000:2.0:1783969129.191938:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969129.191947:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099122048:0@lo:400: 00000100:00100000:2.0:1783969129.191975:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.192018:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099122176 00000100:00100000:2.0:1783969129.192024:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099122176 00000100:00100000:2.0:1783969129.192189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969129.192198:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc6eaa33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+12:7451:x1870627099122176:12345-0@lo:101: 00010000:00010000:2.0:1783969129.192211:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969129.192221:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9754 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.192243:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9754 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.192323:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9754 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.192332:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000fb5fe7c, rc 0) 00000100:00100000:2.0:1783969129.192372:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc6eaa33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:7451:x1870627099122176:12345-0@lo:101: Request processed in 175us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.192413:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969129.192452:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099122048 00000100:00100000:2.0:1783969129.192456:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099122048 00000100:00100000:2.0:1783969129.192482:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969129.192488:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009376e8f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099122048:12345-0@lo:400: 00000100:00100000:2.0:1783969129.192546:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009376e8f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099122048:12345-0@lo:400: Request processed in 58us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.192553:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783969129.192759:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000075ce0356 x1870627099122048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969129.192772:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099122048:0@lo:400: 00000100:00100000:2.0:1783969129.192805:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a5e7f519 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122176:0@lo:101: 00010000:00010000:2.0:1783969129.192819:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.192827:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969129.195657:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a5e7f519 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122304:0@lo:256: 00000100:00100000:2.0:1783969129.195739:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.195781:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8f0af7f going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.200841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099122304 00000100:00100000:1.0:1783969129.200858:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099122304 00000100:00100000:1.0:1783969129.200915:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783969129.200925:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f321af03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:7451:x1870627099122304:12345-0@lo:256: 20000000:01000000:1.0:1783969129.200951:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783969129.200968:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783969129.200971:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783969129.202350:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a5e7f519 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122304:0@lo:256: 10000000:01000000:3.0:1783969129.202967:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969129.202983:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.202994:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969129.203002:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab929d800 from 1 10000000:01000000:3.0:1783969129.203005:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969129.203035:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.203043:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.203051:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969129.203746:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122432:0@lo:101: 00000100:00100000:3.0:1783969129.203799:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969129.203835:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005b825e5 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.203910:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f321af03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:7451:x1870627099122304:12345-0@lo:256: Request processed in 1132us (6316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.203931:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783969129.203965:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099122432 00000100:00100000:1.0:1783969129.203971:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099122432 00000100:00100000:1.0:1783969129.203998:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783969129.204004:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ce9ea79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:7451:x1870627099122432:12345-0@lo:101: 00010000:00010000:1.0:1783969129.204017:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969129.204029:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9762 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.204052:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9762 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.206071:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9762 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.206087:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000064935844, rc 0) 00000100:00100000:1.0:1783969129.206170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ce9ea79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:7451:x1870627099122432:12345-0@lo:101: Request processed in 2164us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.206178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783969129.210028:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122432:0@lo:101: 00010000:00010000:3.0:1783969129.210057:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.210069:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969129.210509:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122560:0@lo:501: 00000100:00100000:3.0:1783969129.210572:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969129.211075:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005b825e5 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.215774:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099122560 00000100:00100000:1.0:1783969129.215790:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099122560 00000100:00100000:1.0:1783969129.215857:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783969129.215867:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0a741d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:7451:x1870627099122560:12345-0@lo:501: 00000100:00100000:1.0:1783969129.216032:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0a741d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:7451:x1870627099122560:12345-0@lo:501: Request processed in 166us (5459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.216040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969129.217654:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122560:0@lo:501: 00000100:00100000:3.0:1783969129.217719:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122688:0@lo:503: 00000100:00100000:3.0:1783969129.217792:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969129.217839:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005b825e5 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.217904:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099122688 00000100:00100000:1.0:1783969129.217911:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099122688 00000100:00100000:1.0:1783969129.217969:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969129.217978:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0aca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:7451:x1870627099122688:12345-0@lo:503: 00000040:00080000:1.0:1783969129.218025:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783969129.218077:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0aca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:7451:x1870627099122688:12345-0@lo:503: Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.218085:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969129.218290:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122688:0@lo:503: 00000040:00080000:3.0:1783969129.218618:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969129.218667:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1783969129.218748:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1783969129.219555:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000c74d8b5f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969129.219637:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8771818 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1870627099121920:12345-0@lo:38: Request processed in 30514us (30690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969129.219651:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969129.219755:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969129.219763:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1783969129.219772:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783969129.219777:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783969129.219779:0:3645:0:(import.c:65:import_set_state_nolock()) 0000000057228922 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783969129.219793:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009017bf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099121920:0@lo:38: 00000100:00100000:0.0:1783969129.219852:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099122816:0@lo:41: 00000100:00100000:0.0:1783969129.219885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.219929:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099122816 00000100:00100000:0.0:1783969129.219940:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099122816 00000100:00100000:0.0:1783969129.219970:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969129.219977:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c9bf02f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1870627099122816:12345-0@lo:41: 00000004:00000024:0.0:1783969129.220002:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1783969129.220039:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c9bf02f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1870627099122816:12345-0@lo:41: Request processed in 62us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969129.220045:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969129.220082:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099122816:0@lo:41: 00000040:00080000:2.0:1783969129.225726:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1783969129.225925:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1783969129.225954:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969129.225976:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.225989:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969129.226039:0:7451:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783969129.226043:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93eab929d800 10000000:01000000:0.0:1783969129.226046:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93eab929d800 10000000:01000000:0.0:1783969129.226049:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783969129.226054:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93eab929d800 from 1 10000000:01000000:0.0:1783969129.226057:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783969129.226092:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000083d62dd6/0xea31253a47cb9770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.226101:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000083d62dd6/0xea31253a47cb9770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.226111:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000083d62dd6/0xea31253a47cb9770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969129.226153:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122944:0@lo:101: 00000100:00100000:0.0:1783969129.226219:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.226259:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ddd2888 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.226343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099122944 00000100:00100000:1.0:1783969129.226351:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099122944 00000100:00100000:1.0:1783969129.226420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969129.226428:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050786781 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:7451:x1870627099122944:12345-0@lo:101: 00010000:00010000:1.0:1783969129.226441:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969129.226453:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab509550/0xea31253a47cb9777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9770 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.226474:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab509550/0xea31253a47cb9777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9770 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.226484:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab509550/0xea31253a47cb9777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9770 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969129.226491:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab509550, rc 0) 00000100:00100000:1.0:1783969129.226541:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050786781 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099122944:12345-0@lo:101: Request processed in 113us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.226548:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783969129.226722:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099122944:0@lo:101: 00010000:00010000:0.0:1783969129.226736:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000083d62dd6/0xea31253a47cb9770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.226745:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000083d62dd6/0xea31253a47cb9770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969129.226829:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123072:0@lo:501: 00000100:00100000:0.0:1783969129.226856:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.226888:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ddd2888 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.227965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099123072 00000100:00100000:1.0:1783969129.227975:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099123072 00000100:00100000:1.0:1783969129.228020:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783969129.228027:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b27e982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099123072:12345-0@lo:501: 00000100:00100000:1.0:1783969129.228156:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b27e982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099123072:12345-0@lo:501: Request processed in 129us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.228176:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783969129.228280:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123072:0@lo:501: 00000100:00100000:0.0:1783969129.228319:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123200:0@lo:503: 00000100:00100000:0.0:1783969129.228362:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.228422:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ddd2888 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.228484:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099123200 00000100:00100000:1.0:1783969129.228488:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099123200 00000100:00100000:1.0:1783969129.228530:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783969129.228536:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080f61303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099123200:12345-0@lo:503: 00000100:00100000:1.0:1783969129.228625:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080f61303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099123200:12345-0@lo:503: Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.228631:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783969129.228750:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123200:0@lo:503: 00000040:00080000:0.0:1783969129.229023:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783969129.229083:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123328:0@lo:502: 00000100:00100000:0.0:1783969129.229120:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.229151:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000006cbb5f9e going to sleep for 11 seconds 00000100:00100000:2.0:1783969129.229236:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099123328 00000100:00100000:2.0:1783969129.229242:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099123328 00000100:00100000:2.0:1783969129.229267:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783969129.229273:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab316b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099123328:12345-0@lo:502: 00000100:00100000:2.0:1783969129.229357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab316b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099123328:12345-0@lo:502: Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.229364:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783969129.230022:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123328:0@lo:502: 00000040:00080000:0.0:1783969129.230193:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783969129.230233:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783969129.230245:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783969129.230256:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783969129.230267:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783969129.230278:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783969129.230288:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783969129.230298:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783969129.230308:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783969129.230318:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783969129.230328:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783969129.230338:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783969129.230348:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783969129.230358:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783969129.230370:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783969129.230418:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783969129.230432:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783969129.230451:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783969129.230462:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783969129.230472:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783969129.230482:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783969129.230492:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783969129.230516:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783969129.230527:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783969129.230537:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1783969129.230547:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1783969129.230557:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1783969129.230567:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1783969129.230592:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123456:0@lo:502: 00000100:00100000:1.0:1783969129.231340:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969129.231461:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000006cbb5f9e going to sleep for 11 seconds 00000100:00100000:2.0:1783969129.231516:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099123456 00000100:00100000:2.0:1783969129.231522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099123456 00000100:00100000:2.0:1783969129.231603:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783969129.231610:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a25aead2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099123456:12345-0@lo:502: 00000100:00100000:2.0:1783969129.231712:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a25aead2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099123456:12345-0@lo:502: Request processed in 102us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.231719:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783969129.231792:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123456:0@lo:502: 00000040:00080000:0.0:1783969129.231842:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1783969129.231850:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1783969129.232294:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783969129.232308:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000003a0d4735) 00000020:00000080:0.0:1783969129.232336:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1783969129.232515:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000076b0ffbd from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783969129.232519:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000076b0ffbd from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783969129.232522:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000076b0ffbd 3 00010000:00080000:0.0:1783969129.232545:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000214ce6dd@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969129.234631:0:7469:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1783969129.234734:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783969129.234775:0:7469:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783969129.234789:0:7469:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xea31253a47cb9785 00000100:00080000:0.0:1783969129.234800:0:7469:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969129.234805:0:7469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000214ce6dd using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969129.234845:0:7469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000844bcf4d x1870627099123584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969129.234892:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870627099123584:0@lo:38: 00000100:00100000:0.0:1783969129.234970:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783969129.235034:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783969129.243221:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099123584 00000100:00100000:2.0:1783969129.243236:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099123584 00000100:00100000:2.0:1783969129.243286:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969129.243294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a13683e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1870627099123584:12345-0@lo:38: 00010000:00080000:2.0:1783969129.243323:0:6522:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1783969129.243357:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xea31253a47cb978c 00000004:00100000:2.0:1783969129.243373:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783969129.243434:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000131e23fe : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969129.243534:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a13683e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870627099123584:12345-0@lo:38: Request processed in 239us (8563us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.243542:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783969129.243621:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000844bcf4d x1870627099123584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969129.243632:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969129.243640:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783969129.243647:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783969129.243651:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783969129.243653:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000214ce6dd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783969129.243659:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000844bcf4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870627099123584:0@lo:38: 00000040:00080000:0.0:1783969129.243931:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1783969129.244118:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:2.0:1783969129.244205:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1783969129.244231:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783969129.244264:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000083d62dd6/0xea31253a47cb9770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.244273:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000083d62dd6/0xea31253a47cb9770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783969129.244321:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783969129.244323:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783969129.244325:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969129.244326:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969129.244327:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969129.244328:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969129.244330:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969129.244331:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969129.244333:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969129.244334:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969129.244336:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783969129.244340:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1783969129.244343:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783969129.244344:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783969129.244345:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969129.244346:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969129.244347:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969129.244348:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969129.244349:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969129.244350:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969129.244350:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969129.244351:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969129.244352:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783969129.244372:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783969129.244424:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123712:0@lo:253: 00000100:00100000:2.0:1783969129.244475:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.244512:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b3621c3 going to sleep for 11 seconds 00000100:00100000:0.0:1783969129.244638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099123712 00000100:00100000:0.0:1783969129.244643:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099123712 00000100:00100000:0.0:1783969129.244682:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783969129.244690:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e35609 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7451:x1870627099123712:12345-0@lo:253: 20000000:01000000:0.0:1783969129.244712:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783969129.244725:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1783969129.247775:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1783969129.247874:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783969129.247896:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1783969129.248005:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783969129.248010:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783969129.248029:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.248053:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb96ac expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.248060:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9754 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.248067:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.248105:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9754 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.248118:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9754 expref: 15 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969129.248131:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000084267d6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099123840:0@lo:104: 00000100:00100000:2.0:1783969129.248192:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969129.248247:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb96ac expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.248254:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb96ac expref: 15 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969129.248263:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000081393e83 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099123968:0@lo:104: 00000100:00100000:2.0:1783969129.248284:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.248307:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b75a4ae going to sleep for 11 seconds 00000100:00100000:3.0:1783969129.248358:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099123840 00000100:00100000:3.0:1783969129.248364:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099123840 00000100:00100000:3.0:1783969129.248427:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099123968 00000100:00100000:3.0:1783969129.248431:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099123968 00000100:00100000:3.0:1783969129.248443:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969129.248450:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aafe7478 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6537:x1870627099123840:12345-0@lo:104: 00010000:00010000:3.0:1783969129.248462:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248527:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783969129.248533:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aafe7478 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6537:x1870627099123840:12345-0@lo:104: Request processed in 84us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969129.248539:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969129.248556:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969129.248561:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c713baad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6537:x1870627099123968:12345-0@lo:104: 00010000:00010000:3.0:1783969129.248567:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248613:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783969129.248618:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c713baad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6537:x1870627099123968:12345-0@lo:104: Request processed in 58us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969129.248624:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783969129.248638:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969129.248643:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248651:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000033b362da already unused, calling callback (000000006c6f1bb4) 10000000:00010000:3.0:1783969129.248653:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248661:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969129.248674:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969129.248679:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969129.248706:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248712:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969129.248724:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248730:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 0000000033b362da/0xea31253a47cb9754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb975b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248742:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969129.248744:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248749:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004d6d04b7 already unused, calling callback (000000006c6f1bb4) 10000000:00010000:3.0:1783969129.248751:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248757:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969129.248762:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969129.248767:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969129.248786:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248792:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969129.248804:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248809:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 000000004d6d04b7/0xea31253a47cb96ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb96b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248822:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969129.248824:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969129.248825:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969129.248832:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969129.248843:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073c684b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099124224:0@lo:103: 00000100:00100000:3.0:1783969129.248869:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969129.248895:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099124224 00000100:00100000:3.0:1783969129.248898:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099124224 00010000:00010000:3.0:1783969129.248913:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb96ac expref: 16 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969129.248932:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969129.248937:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000456667ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3649:x1870627099124224:12345-0@lo:103: 00010000:00010000:3.0:1783969129.248946:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969129.248951:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb96ac expref: 16 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248959:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb96ac expref: 16 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969129.248973:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969129.249007:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000456667ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3649:x1870627099124224:12345-0@lo:103: Request processed in 70us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969129.249013:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969129.249050:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073c684b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099124224:0@lo:103: 00000100:00100000:2.0:1783969129.249177:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000084267d6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099123840:0@lo:104: 00010000:00010000:2.0:1783969129.249186:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007380d9a4/0xea31253a47cb96b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb96ac expref: 15 pid: 6515 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969129.249207:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000081393e83 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099123968:0@lo:104: 00010000:00010000:2.0:1783969129.249223:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249482:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969129.249501:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099124096:0@lo:103: 00000100:00100000:0.0:1783969129.249541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.249641:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099124096 00000100:00100000:0.0:1783969129.249646:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099124096 00010000:00010000:0.0:1783969129.249662:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9754 expref: 15 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969129.249683:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969129.249689:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da77f12c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3647:x1870627099124096:12345-0@lo:103: 00010000:00010000:0.0:1783969129.249697:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969129.249700:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9754 expref: 15 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249708:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9754 expref: 15 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249717:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000fb5fe7c/0xea31253a47cb975b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9754 expref: 15 pid: 6514 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249728:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249734:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783969129.249748:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001737984s 00010000:00010000:0.0:1783969129.249751:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249757:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249772:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249778:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249782:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f9fcf6d8 already unused, calling callback (00000000fc97f683) 00010000:00010000:0.0:1783969129.249785:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249792:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249803:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969129.249812:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969129.249839:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da77f12c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:3647:x1870627099124096:12345-0@lo:103: Request processed in 150us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969129.249846:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969129.249901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a190cc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099124096:0@lo:103: 00010000:00010000:2.0:1783969129.249955:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.249963:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969129.249970:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb9793 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969129.250864:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e35609 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:7451:x1870627099123712:12345-0@lo:253: Request processed in 6172us (6386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969129.250877:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783969129.255840:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:7451:1870627099123712:0@lo:253: 10000000:01000000:2.0:1783969129.255862:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783969129.255866:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969129.255867:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783969129.255869:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969129.255870:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969129.255871:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969129.255873:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969129.255874:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969129.255875:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969129.255877:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969129.255878:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969129.255880:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783969129.255894:0:7451:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783969129.265096:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1783969129.266327:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1783969129.266580:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783969129.266775:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1783969129.266981:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783969129.267190:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783969129.267358:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1783969129.269371:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1783969129.269987:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1783969129.270314:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1783969129.272355:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1783969129.272944:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1783969129.273309:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1783969129.275504:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1783969129.276309:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1783969129.276365:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000030e31596 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1870627099124352:0@lo:700: 00000040:01000000:3.0:1783969129.276482:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1783969129.276767:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.276812:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 0000000069de273d going to sleep for 11 seconds 00000100:00100000:3.0:1783969129.276871:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099124352 00000100:00100000:3.0:1783969129.276880:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099124352 00000100:00100000:3.0:1783969129.276934:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969129.276943:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e0da989 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1870627099124352:12345-0@lo:700: 00000020:00080000:2.0:1783969129.277269:0:7474:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1783969129.277273:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1783969129.280005:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058145388 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099124480:0@lo:1000: 00000100:00100000:0.0:1783969129.280092:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.280142:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 000000009bf74d0d going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.280423:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099124480 00000100:00100000:1.0:1783969129.280432:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099124480 00000100:00100000:1.0:1783969129.280483:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969129.280502:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a87344f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099124480:12345-0@lo:1000: 00000100:00100000:1.0:1783969129.280582:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a87344f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099124480:12345-0@lo:1000: Request processed in 91us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969129.280590:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969129.280759:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058145388 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099124480:0@lo:1000: 00000040:01000000:0.0:1783969129.280788:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1783969129.280817:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058145388 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099124608:0@lo:700: 00000100:00100000:0.0:1783969129.280843:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.280869:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e280c8b going to sleep for 11 seconds 00000100:00100000:2.0:1783969129.280929:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099124608 00000100:00100000:2.0:1783969129.280934:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099124608 00000100:00100000:2.0:1783969129.280978:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969129.280984:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f8fc47b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099124608:12345-0@lo:700: 00000100:00100000:2.0:1783969129.281027:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f8fc47b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099124608:12345-0@lo:700: Request processed in 44us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.281034:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969129.281188:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058145388 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099124608:0@lo:700: 00000100:00100000:1.0:1783969129.281227:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000387b930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1870627099124736:0@lo:900: 00000100:00100000:1.0:1783969129.281256:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969129.281279:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 000000007f674194 going to sleep for 11 seconds 00000100:00100000:2.0:1783969129.281405:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099124736 00000100:00100000:2.0:1783969129.281409:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099124736 00000100:00100000:2.0:1783969129.281435:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969129.281441:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007acfab8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1870627099124736:12345-0@lo:900: 00000100:00100000:2.0:1783969129.281486:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007acfab8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1870627099124736:12345-0@lo:900: Request processed in 45us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.281501:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783969129.281700:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000387b930 x1870627099124736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783969145 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969129.281712:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000387b930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1870627099124736:0@lo:900: 00000100:00100000:1.0:1783969129.281787:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000387b930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099124864:0@lo:1000: 00000100:00100000:1.0:1783969129.281822:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969129.281845:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000032cf8e5 going to sleep for 11 seconds 00000100:00100000:0.0:1783969129.281892:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099124864 00000100:00100000:0.0:1783969129.281897:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099124864 00000100:00100000:0.0:1783969129.281929:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969129.281935:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c210ea1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099124864:12345-0@lo:1000: 00000100:00100000:0.0:1783969129.281998:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c210ea1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099124864:12345-0@lo:1000: Request processed in 63us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969129.282005:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969129.282143:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000387b930 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099124864:0@lo:1000: 00000004:00080000:2.0:1783969129.282252:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000007f674194 with version 0 00000020:00100000:2.0:1783969129.282267:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783969129.282272:0:7476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000075ce0356 x1870627099125120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969129.282284:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099125120:0@lo:1000: 00000100:00100000:2.0:1783969129.282310:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969129.282332:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 000000007f8677e1 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.282408:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099125120 00000100:00100000:1.0:1783969129.282413:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099125120 00000100:00100000:1.0:1783969129.282432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969129.282438:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081393e83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099125120:12345-0@lo:1000: 00000040:01000000:3.0:1783969129.284025:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1783969129.285887:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1783969129.286259:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1783969129.286484:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081393e83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099125120:12345-0@lo:1000: Request processed in 4042us (4170us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783969129.286507:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 40000000:02000000:2.0:1783969129.286721:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000004:00080000:0.0:1783969129.287279:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1783969129.287285:0:7476:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783969129.287300:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099125120:0@lo:1000: 00000100:00100000:0.0:1783969129.287414:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d11a68ee pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099125248:0@lo:1000: 00000100:00100000:0.0:1783969129.287458:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969129.287486:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099125248 00000100:00100000:0.0:1783969129.287503:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099125248 00000100:00100000:0.0:1783969129.287543:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969129.287550:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cfafd97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099125248:12345-0@lo:1000: 00000004:00000080:3.0:1783969129.287941:0:7451:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783969129.287973:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1783969129.289431:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cfafd97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1870627099125248:12345-0@lo:1000: Request processed in 1875us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969129.289445:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969129.289486:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c245789c going to sleep for 11 seconds 00000100:00100000:0.0:1783969129.289528:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d11a68ee pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1870627099125248:0@lo:1000: 00000040:00080000:0.0:1783969129.289556:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1783969129.289593:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009bf74d0d with version 1 00000040:00080000:3.0:1783969129.291516:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1783969129.292211:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000007fade6b2 version 1 rpc_version 1 00000020:00100000:1.0:1783969129.292249:0:7465:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783969129.292259:0:7465:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006d32e5a7 x1870627099125504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969129.292282:0:7465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d32e5a7 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1870627099125504:0@lo:1000: 00000100:00100000:1.0:1783969129.292354:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969129.292406:0:7465:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef2636e1 going to sleep for 11 seconds 00000100:00100000:1.0:1783969129.292430:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099125504 00000100:00100000:1.0:1783969129.292436:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099125504 00000100:00100000:1.0:1783969129.292477:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783969129.292484:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002394e92d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1870627099125504:12345-0@lo:1000: 00000001:00080000:1.0:1783969129.296266:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1783969129.296419:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002394e92d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1870627099125504:12345-0@lo:1000: Request processed in 3931us (4062us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783969129.296432:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1783969129.296486:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1783969129.296503:0:7465:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783969129.296521:0:7465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d32e5a7 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1870627099125504:0@lo:1000: 00000040:00080000:3.0:1783969129.296857:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783969129.314440:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783969129.314569:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1783969129.314823:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783969129.316455:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000040:00080000:0.0:1783969129.316799:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783969129.316868:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1783969129.321821:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e0da989 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1870627099124352:12345-0@lo:700: Request processed in 44875us (45052us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969129.321840:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783969129.322123:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000030e31596 x1870627099124352/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783969145 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969129.322138:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000030e31596 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1870627099124352:0@lo:700: 40000000:02000000:0.0:1783969129.322151:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1783969129.328930:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1783969129.329663:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1783969129.329808:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1783969129.329941:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1783969129.330271:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1783969129.330530:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1783969129.330720:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1783969129.330853:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1783969129.331724:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1783969129.331933:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1783969129.334695:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1783969129.334866:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1783969129.337271:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1783969129.341397:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1783969129.341633:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1783969129.341768:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1783969129.342093:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1783969129.342228:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1783969129.342353:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1783969129.345443:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1783969129.349711:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1783969129.349900:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1783969129.350211:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000040:00080000:1.0:1783969129.350300:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1783969129.350356:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1783969129.350526:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1783969129.352831:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1783969129.358565:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1783969129.358782:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1783969129.358915:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1783969129.360369:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1783969129.360557:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1783969129.360706:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1783969129.360892:0:7451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1783969129.372302:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783969129.372424:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783969129.372430:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1783969129.383071:0:7451:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783969129.383117:0:7451:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffafc3c1c53988 00100000:10000000:3.0:1783969129.383127:0:7451:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1783969129.388039:0:7451:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783969129.388077:0:7451:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783969129.388101:0:7451:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783969129.388121:0:7451:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1783969129.396048:0:7451:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969129.399600:0:7451:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1783969130.294437:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969131.313825:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969132.336627:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969133.365209:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969134.386184:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969134.451574:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000030e31596 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099125632:0@lo:41: 00000100:00100000:2.0:1783969134.451648:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969134.451726:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099125632 00000100:00100000:2.0:1783969134.451733:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099125632 00000100:00100000:2.0:1783969134.451775:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969134.451783:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000084267d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099125632:12345-0@lo:41: 00000004:00000024:2.0:1783969134.451820:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1783969134.451863:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000084267d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099125632:12345-0@lo:41: Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969134.451870:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969134.452030:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d11a68ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099125760:0@lo:400: 00000100:00100000:0.0:1783969134.452067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969134.452093:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969134.452099:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b2676050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099125888:0@lo:400: 00000100:00100000:0.0:1783969134.452125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969134.452186:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000030e31596 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099125632:0@lo:41: 00000100:00100000:2.0:1783969134.452202:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969134.452206:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000007efa0af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099126016:0@lo:400: 00000100:00100000:2.0:1783969134.452230:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969134.452295:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099125760 00000100:00100000:2.0:1783969134.452299:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099125760 00000100:00100000:2.0:1783969134.452325:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783969134.452332:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000719d27b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:3646:x1870627099125760:12345-0@lo:400: 00000100:00100000:2.0:1783969134.452366:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000719d27b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:3646:x1870627099125760:12345-0@lo:400: Request processed in 35us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969134.452373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783969134.459149:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099125888 00000100:00100000:0.0:1783969134.459163:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099125888 00000100:00100000:0.0:1783969134.459226:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099126016 00000100:00100000:0.0:1783969134.459229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099126016 00000100:00100000:0.0:1783969134.459252:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969134.459260:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081ed5fa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099125888:12345-0@lo:400: 00000100:00100000:0.0:1783969134.459347:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081ed5fa2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099125888:12345-0@lo:400: Request processed in 88us (7221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.459354:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969134.459370:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783969134.459375:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c70da44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099126016:12345-0@lo:400: 00000100:00100000:0.0:1783969134.459447:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c70da44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099126016:12345-0@lo:400: Request processed in 72us (7216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.459454:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783969134.465675:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b2676050 x1870627099125888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969134.465696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b2676050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099125888:0@lo:400: 00000100:00100000:2.0:1783969134.465710:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d11a68ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099125760:0@lo:400: 00010000:00080000:2.0:1783969134.465759:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000007efa0af x1870627099126016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969134.465768:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000007efa0af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099126016:0@lo:400: 00000001:02000400:3.0:1783969134.503746:0:7721:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1783969134.965302:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783969134.965312:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93eab929d800 from 4 10000000:01000000:3.0:1783969134.965317:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783969134.965367:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb979a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969134.965423:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb979a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969134.965435:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb979a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969134.965462:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073c684b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126144:0@lo:101: 00000100:00100000:3.0:1783969134.965543:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969134.965594:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f1fd65d3 going to sleep for 11 seconds 00000100:00100000:1.0:1783969134.966289:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099126144 00000100:00100000:1.0:1783969134.966300:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099126144 00000100:00100000:1.0:1783969134.966354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783969134.966363:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d488f459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:6518:x1870627099126144:12345-0@lo:101: 00010000:00010000:1.0:1783969134.966378:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969134.966425:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb58781f/0xea31253a47cb97a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb979a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.966449:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb58781f/0xea31253a47cb97a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb979a expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.966459:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb58781f/0xea31253a47cb97a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb979a expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.966466:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb58781f, rc 0) 00000100:00100000:1.0:1783969134.966528:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d488f459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:6518:x1870627099126144:12345-0@lo:101: Request processed in 166us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969134.966535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783969134.968996:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073c684b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126144:0@lo:101: 00010000:00010000:3.0:1783969134.969026:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb979a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969134.969058:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb979a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969134.969126:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073c684b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126272:0@lo:256: 00000100:00100000:3.0:1783969134.969189:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969134.969233:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f1fd65d3 going to sleep for 11 seconds 00000100:00100000:2.0:1783969134.969255:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099126272 00000100:00100000:2.0:1783969134.969262:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099126272 00000100:00100000:2.0:1783969134.969319:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969134.969326:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dad9930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:6518:x1870627099126272:12345-0@lo:256: 20000000:01000000:2.0:1783969134.969346:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783969134.969363:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783969134.969366:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783969134.969482:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dad9930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:6518:x1870627099126272:12345-0@lo:256: Request processed in 156us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969134.969502:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783969134.971611:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073c684b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126272:0@lo:256: 10000000:01000000:1.0:1783969134.971852:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783969134.971861:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb979a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.971870:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000c55a4c33/0xea31253a47cb979a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969134.971893:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783969134.971895:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93ea912c9800 from 21 10000000:01000000:1.0:1783969134.971898:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783969134.971931:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000064b4683f/0xea31253a47cb97a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.971938:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000064b4683f/0xea31253a47cb97a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.971946:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000064b4683f/0xea31253a47cb97a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969134.971963:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d32e5a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126400:0@lo:101: 00000100:00100000:1.0:1783969134.972018:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969134.972078:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000142c7787 going to sleep for 11 seconds 00000100:00100000:2.0:1783969134.972448:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099126400 00000100:00100000:2.0:1783969134.972455:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099126400 00000100:00100000:2.0:1783969134.972507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783969134.972514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000972e39bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:6518:x1870627099126400:12345-0@lo:101: 00010000:00010000:2.0:1783969134.972527:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969134.972540:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000033b362da/0xea31253a47cb97af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb97a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969134.972562:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000033b362da/0xea31253a47cb97af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb97a8 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969134.972570:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000033b362da/0xea31253a47cb97af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb97a8 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969134.972577:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000033b362da, rc 0) 00000100:00100000:2.0:1783969134.972622:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000972e39bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099126400:12345-0@lo:101: Request processed in 108us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969134.972628:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783969134.972868:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d32e5a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126400:0@lo:101: 00010000:00010000:1.0:1783969134.972882:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000064b4683f/0xea31253a47cb97a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.972892:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000064b4683f/0xea31253a47cb97a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969134.972950:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d32e5a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126528:0@lo:501: 00000100:00100000:1.0:1783969134.972976:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969134.973008:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000142c7787 going to sleep for 11 seconds 00000100:00100000:0.0:1783969134.973068:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099126528 00000100:00100000:0.0:1783969134.973079:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099126528 00000100:00100000:0.0:1783969134.973109:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783969134.973115:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002157c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099126528:12345-0@lo:501: 00000100:00100000:0.0:1783969134.973225:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002157c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099126528:12345-0@lo:501: Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.973232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783969134.973349:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d32e5a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126528:0@lo:501: 00000100:00100000:1.0:1783969134.973374:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d32e5a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126656:0@lo:503: 00000100:00100000:1.0:1783969134.973451:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969134.973470:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000142c7787 going to sleep for 11 seconds 00000100:00100000:2.0:1783969134.973646:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099126656 00000100:00100000:2.0:1783969134.973656:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099126656 00000100:00100000:2.0:1783969134.973678:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783969134.973684:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a696cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099126656:12345-0@lo:503: 00000100:00100000:2.0:1783969134.973775:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a696cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099126656:12345-0@lo:503: Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969134.973781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783969134.974464:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d32e5a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099126656:0@lo:503: 00000100:00100000:3.0:1783969134.975756:0:7743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d36d9482 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7743:1870627099126784:0@lo:502: 00000100:00100000:3.0:1783969134.975833:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969134.975873:0:7743:0:(client.c:2702:ptlrpc_set_wait()) set 0000000044ef5880 going to sleep for 11 seconds 00000100:00100000:2.0:1783969134.975927:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099126784 00000100:00100000:2.0:1783969134.975933:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099126784 00000100:00100000:2.0:1783969134.975977:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783969134.975986:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cf31e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7743:x1870627099126784:12345-0@lo:502: 00000100:00100000:2.0:1783969134.976227:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cf31e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7743:x1870627099126784:12345-0@lo:502: Request processed in 242us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969134.976235:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783969134.977193:0:7743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d36d9482 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7743:1870627099126784:0@lo:502: 00000100:00100000:3.0:1783969134.977261:0:7743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d36d9482 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7743:1870627099126912:0@lo:502: 00000100:00100000:3.0:1783969134.977308:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969134.977335:0:7743:0:(client.c:2702:ptlrpc_set_wait()) set 0000000044ef5880 going to sleep for 11 seconds 00000100:00100000:0.0:1783969134.977422:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099126912 00000100:00100000:0.0:1783969134.977435:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099126912 00000100:00100000:0.0:1783969134.977472:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783969134.977479:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a521e0d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7743:x1870627099126912:12345-0@lo:502: 00000100:00100000:0.0:1783969134.977591:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a521e0d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:7743:x1870627099126912:12345-0@lo:502: Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.977599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783969134.977907:0:7743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d36d9482 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7743:1870627099126912:0@lo:502: 00000040:00080000:3.0:1783969134.977928:0:7743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1783969134.978092:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1783969134.978115:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969134.978123:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000064b4683f/0xea31253a47cb97a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.978133:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000064b4683f/0xea31253a47cb97a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969134.978143:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783969134.978145:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93ea912c9800 from 4 10000000:01000000:1.0:1783969134.978147:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783969134.978171:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb97b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.978178:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb97b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969134.978187:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb97b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969134.978200:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041392a1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127040:0@lo:101: 00000100:00100000:1.0:1783969134.978231:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969134.978263:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000011f63eae going to sleep for 11 seconds 00000100:00100000:0.0:1783969134.983958:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099127040 00000100:00100000:0.0:1783969134.983973:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099127040 00000100:00100000:0.0:1783969134.984033:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783969134.984042:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003123711c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099127040:12345-0@lo:101: 00010000:00010000:0.0:1783969134.984061:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969134.984080:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000151c9ed8/0xea31253a47cb97bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb97b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.984108:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000151c9ed8/0xea31253a47cb97bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb97b6 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.984118:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000151c9ed8/0xea31253a47cb97bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb97b6 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.984127:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000151c9ed8, rc 0) 00000100:00100000:0.0:1783969134.984203:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003123711c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099127040:12345-0@lo:101: Request processed in 163us (5972us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.984211:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783969134.984264:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041392a1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127040:0@lo:101: 00010000:00010000:0.0:1783969134.984282:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb97b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.984290:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb97b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969134.984359:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e72f8e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127168:0@lo:256: 00000100:00100000:0.0:1783969134.984424:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969134.984455:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a51b3f4b going to sleep for 11 seconds 00000100:00100000:0.0:1783969134.984469:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099127168 00000100:00100000:0.0:1783969134.984472:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099127168 00000100:00100000:0.0:1783969134.984494:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783969134.984499:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d59e906c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099127168:12345-0@lo:256: 20000000:01000000:0.0:1783969134.984513:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783969134.984528:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783969134.984531:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1783969134.984604:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d59e906c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099127168:12345-0@lo:256: Request processed in 104us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.984611:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783969134.984642:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e72f8e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127168:0@lo:256: 10000000:01000000:0.0:1783969134.985572:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783969134.985582:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb97b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.985592:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000053a8d030/0xea31253a47cb97b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969134.985602:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783969134.985604:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1783969134.985607:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783969134.985632:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000007c504b71/0xea31253a47cb97c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.985650:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000007c504b71/0xea31253a47cb97c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.985659:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000007c504b71/0xea31253a47cb97c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969134.986100:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e72f8e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127296:0@lo:101: 00000100:00100000:0.0:1783969134.986152:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969134.986227:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a51b3f4b going to sleep for 11 seconds 00000100:00100000:3.0:1783969134.993881:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099127296 00000100:00100000:3.0:1783969134.993897:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099127296 00000100:00100000:0.0:1783969134.996080:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783969134.996093:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000930acac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099127296:12345-0@lo:101: 00010000:00010000:0.0:1783969134.996113:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969134.996130:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb97cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb97c4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.996159:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb97cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb97c4 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.996170:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e46eeb4f/0xea31253a47cb97cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb97c4 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.996178:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e46eeb4f, rc 0) 00000100:00100000:0.0:1783969134.996254:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000930acac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099127296:12345-0@lo:101: Request processed in 163us (10102us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.996262:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783969134.996323:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e72f8e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127296:0@lo:101: 00010000:00010000:0.0:1783969134.996341:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000007c504b71/0xea31253a47cb97c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969134.996362:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000007c504b71/0xea31253a47cb97c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969134.996781:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e72f8e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127424:0@lo:501: 00000100:00100000:0.0:1783969134.996824:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969134.996857:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd9e5305 going to sleep for 11 seconds 00000100:00100000:0.0:1783969134.996873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099127424 00000100:00100000:0.0:1783969134.996878:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099127424 00000100:00100000:0.0:1783969134.996902:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783969134.996907:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048e5df06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099127424:12345-0@lo:501: 00000100:00100000:0.0:1783969134.997027:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048e5df06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099127424:12345-0@lo:501: Request processed in 119us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.997035:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783969134.997068:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e72f8e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127424:0@lo:501: 00000100:00100000:0.0:1783969134.997100:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e72f8e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127552:0@lo:503: 00000100:00100000:0.0:1783969134.997141:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969134.997154:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd9e5305 going to sleep for 11 seconds 00000100:00100000:0.0:1783969134.997165:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099127552 00000100:00100000:0.0:1783969134.997168:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099127552 00000100:00100000:0.0:1783969134.997184:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783969134.997190:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d62c9173 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099127552:12345-0@lo:503: 00000100:00100000:0.0:1783969134.997274:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d62c9173 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099127552:12345-0@lo:503: Request processed in 84us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.997280:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969134.997287:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e72f8e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099127552:0@lo:503: 00000100:00100000:2.0:1783969134.997650:0:7744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e18343b pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7744:1870627099127680:0@lo:502: 00000100:00100000:2.0:1783969134.997688:0:7744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969134.997710:0:7744:0:(client.c:2702:ptlrpc_set_wait()) set 000000003993c3bd going to sleep for 11 seconds 00000100:00100000:0.0:1783969134.998027:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099127680 00000100:00100000:0.0:1783969134.998040:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099127680 00000100:00100000:0.0:1783969134.998075:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783969134.998081:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e80aad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:7744:x1870627099127680:12345-0@lo:502: 00000100:00100000:0.0:1783969134.998174:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e80aad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:7744:x1870627099127680:12345-0@lo:502: Request processed in 93us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969134.998181:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783969134.998206:0:7744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e18343b pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7744:1870627099127680:0@lo:502: 00000020:01000000:2.0:1783969134.998230:0:7744:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969134.998240:0:7744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969134.998242:0:7744:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1783969134.998248:0:7744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783969134.998251:0:7744:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:00000080:2.0:1783969134.998274:0:7744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783969134.998286:0:7744:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000aa7856db) 00000020:00000080:2.0:1783969134.998305:0:7744:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1783969134.998311:0:7744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783969134.998434:0:7744:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1783969134.998440:0:7744:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783969134.998447:0:7744:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cb97d9 00010000:00080000:2.0:1783969134.998480:0:7744:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001dd49e94@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1783969135.000764:0:7744:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1783969135.007225:0:7744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783969135.007240:0:7744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783969135.007273:0:7744:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783969135.007295:0:7744:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cb97e0 00000100:00080000:2.0:1783969135.007305:0:7744:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783969135.007311:0:7744:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000001dd49e94 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969135.007345:0:7744:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002e18343b x1870627099127808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969135.007372:0:7744:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1783969135.007446:0:7744:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1783969135.007790:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e18343b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099127808:0@lo:38: 00000100:00100000:0.0:1783969135.007865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969135.008195:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000007efa0af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099127936:0@lo:400: 00000100:00100000:0.0:1783969135.008226:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969135.008258:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d11a68ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099128064:0@lo:400: 00000100:00100000:0.0:1783969135.008282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969135.008299:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969135.008304:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b2676050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099128192:0@lo:400: 00000100:00100000:0.0:1783969135.008325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969135.008353:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099127936 00000100:00100000:0.0:1783969135.008360:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099127936 00000100:00100000:0.0:1783969135.008429:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099128192 00000100:00100000:0.0:1783969135.008432:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099128192 00000100:00100000:1.0:1783969135.008443:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783969135.008452:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030e31596 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099127936:12345-0@lo:400: 00000100:00100000:2.0:1783969135.008503:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099127808 00000100:00100000:2.0:1783969135.008508:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099127808 00000100:00100000:2.0:1783969135.008521:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099128064 00000100:00100000:2.0:1783969135.008523:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099128064 00000100:00100000:2.0:1783969135.008539:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969135.008543:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e72f8e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1870627099127808:12345-0@lo:38: 00010000:00080000:2.0:1783969135.008566:0:6527:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1783969135.008603:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cb97e7 00000100:00100000:0.0:1783969135.012906:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783969135.012927:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783969135.012965:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783969135.012985:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969135.012997:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000844bcf4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099128192:12345-0@lo:400: 00000004:00100000:2.0:1783969135.016639:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783969135.016652:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1783969135.019781:0:7748:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000d36d9482 x1870627099128320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969135.019798:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c369683f going to sleep for 0 seconds 00000020:01000000:2.0:1783969135.020337:0:7744:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969135.020344:0:7744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969135.020346:0:7744:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783969135.020349:0:7744:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969135.020361:0:7744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969135.020362:0:7744:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783969135.020364:0:7744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783969135.020366:0:7744:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783969135.020420:0:7744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000081d9022d pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7744:1870627099128448:0@lo:502: 00000100:00100000:2.0:1783969135.020503:0:7744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969135.020546:0:7744:0:(client.c:2702:ptlrpc_set_wait()) set 00000000261bcccb going to sleep for 11 seconds 00000100:00100000:3.0:1783969135.020909:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099128448 00000100:00100000:3.0:1783969135.020916:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099128448 00000100:00100000:3.0:1783969135.020979:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783969135.020987:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a760b3ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:7744:x1870627099128448:12345-0@lo:502: 00000100:00100000:3.0:1783969135.021111:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a760b3ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:7744:x1870627099128448:12345-0@lo:502: Request processed in 125us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969135.021119:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1783969135.021486:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000007efa0af x1870627099127936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969135.021512:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000007efa0af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099127936:0@lo:400: 00000100:00100000:2.0:1783969135.021812:0:7744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000081d9022d pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7744:1870627099128448:0@lo:502: 00000020:01000000:2.0:1783969135.021837:0:7744:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969135.021843:0:7744:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969135.021844:0:7744:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783969135.021847:0:7744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1783969135.022615:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1783969135.022640:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783969135.022650:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000007c504b71/0xea31253a47cb97c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969135.022662:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000007c504b71/0xea31253a47cb97c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969135.022670:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783969135.022672:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93eaa5b00000 from 1 10000000:01000000:2.0:1783969135.022675:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783969135.022706:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000000fb5fe7c/0xea31253a47cb97ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969135.022713:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000000fb5fe7c/0xea31253a47cb97ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969135.022722:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000000fb5fe7c/0xea31253a47cb97ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969135.022754:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000081d9022d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099128576:0@lo:101: 00000100:00100000:2.0:1783969135.022820:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969135.022860:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000261bcccb going to sleep for 11 seconds 00000100:00100000:0.0:1783969135.026335:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000844bcf4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099128192:12345-0@lo:400: Request processed in 13336us (18002us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969135.026352:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783969135.026744:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b2676050 x1870627099128192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969135.026761:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b2676050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099128192:0@lo:400: 00000100:00100000:2.0:1783969135.028457:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099128576 00000100:00100000:2.0:1783969135.028471:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099128576 00000100:00100000:2.0:1783969135.028602:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783969135.028610:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8030257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099128576:12345-0@lo:101: 00010000:00010000:2.0:1783969135.028627:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969135.028643:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb97f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb97ee expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969135.028671:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb97f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb97ee expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969135.028681:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f9fcf6d8/0xea31253a47cb97f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb97ee expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969135.028690:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f9fcf6d8, rc 0) 00000100:00100000:2.0:1783969135.028757:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8030257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099128576:12345-0@lo:101: Request processed in 147us (5937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969135.028763:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783969135.028816:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000081d9022d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099128576:0@lo:101: 00010000:00010000:2.0:1783969135.028832:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000000fb5fe7c/0xea31253a47cb97ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969135.028856:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000000fb5fe7c/0xea31253a47cb97ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969135.028929:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000081d9022d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099128704:0@lo:501: 00000100:00100000:2.0:1783969135.028961:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969135.028988:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000261bcccb going to sleep for 11 seconds 00000100:00100000:2.0:1783969135.029001:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099128704 00000100:00100000:2.0:1783969135.029004:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099128704 00000100:00100000:2.0:1783969135.029026:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783969135.029032:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003299ef15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099128704:12345-0@lo:501: 00000100:00100000:1.0:1783969135.032715:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030e31596 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099127936:12345-0@lo:400: Request processed in 24257us (24481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969135.032754:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969135.035300:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003299ef15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099128704:12345-0@lo:501: Request processed in 6260us (6330us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969135.035317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783969135.035420:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000081d9022d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099128704:0@lo:501: 10000000:01000000:2.0:1783969135.035472:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783969135.035481:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000000fb5fe7c/0xea31253a47cb97ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969135.036184:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000000fb5fe7c/0xea31253a47cb97ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783969135.038610:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000a55b9807 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969135.038714:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e72f8e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1870627099127808:12345-0@lo:38: Request processed in 30168us (30848us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969135.038724:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969135.038756:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783969135.038765:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058145388 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099128064:12345-0@lo:400: 00000100:00100000:0.0:1783969135.038809:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058145388 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099128064:12345-0@lo:400: Request processed in 47us (30527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969135.038815:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783969135.038857:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1783969135.038860:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d11a68ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099128064:0@lo:400: 00000100:00080000:1.0:1783969135.038865:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783969135.038872:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783969135.038876:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783969135.038878:0:3645:0:(import.c:65:import_set_state_nolock()) 000000001dd49e94 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1783969135.038891:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c369683f): req@00000000d36d9482 x1870627099128320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969135.038915:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e18343b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099127808:0@lo:38: 00000100:00100000:0.0:1783969135.040321:0:7748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969135.040372:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c369683f going to sleep for 11 seconds 00000100:00100000:1.0:1783969135.040460:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099128320 00000100:00100000:1.0:1783969135.040476:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099128320 00000100:00100000:1.0:1783969135.040527:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969135.040533:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d11a68ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7748:x1870627099128320:12345-0@lo:1000: 00000100:00100000:1.0:1783969135.040612:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d11a68ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7748:x1870627099128320:12345-0@lo:1000: Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969135.040619:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969135.040813:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969135.040825:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000081d9022d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099128832:0@lo:41: 00000100:00100000:3.0:1783969135.040858:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969135.041021:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d36d9482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099128320:0@lo:1000: 00000040:01000000:0.0:1783969135.041067:0:7748:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783969135.041213:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000081055596 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099128960:0@lo:1000: 00000100:00100000:0.0:1783969135.041239:0:7748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969135.041259:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d91dded7 going to sleep for 11 seconds 00000100:00100000:2.0:1783969135.041296:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099128832 00000100:00100000:2.0:1783969135.041300:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099128832 00000100:00100000:2.0:1783969135.041317:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099128960 00000100:00100000:2.0:1783969135.041319:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099128960 00000100:00100000:2.0:1783969135.041328:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969135.041333:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc826cdd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1870627099128832:12345-0@lo:41: 00000004:00000024:2.0:1783969135.041364:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1783969135.042291:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc826cdd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1870627099128832:12345-0@lo:41: Request processed in 953us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969135.042300:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969135.042324:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969135.042331:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c672c35c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7748:x1870627099128960:12345-0@lo:1000: 00000100:00100000:1.0:1783969135.042448:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000081d9022d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099128832:0@lo:41: 00000100:00100000:3.0:1783969135.056955:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c672c35c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7748:x1870627099128960:12345-0@lo:1000: Request processed in 14617us (15706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969135.056978:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969135.057073:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000081055596 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099128960:0@lo:1000: 00000100:00100000:2.0:1783969135.057141:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006e58d95b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099129088:0@lo:700: 00000100:00100000:2.0:1783969135.057177:0:7748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969135.057208:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set 00000000af85e00f going to sleep for 11 seconds 00000100:00100000:3.0:1783969135.057529:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099129088 00000100:00100000:3.0:1783969135.057536:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099129088 00000100:00100000:3.0:1783969135.057586:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969135.057594:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e62659c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7748:x1870627099129088:12345-0@lo:700: 00000100:00100000:3.0:1783969135.057648:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e62659c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7748:x1870627099129088:12345-0@lo:700: Request processed in 55us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969135.057655:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969135.057918:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006e58d95b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099129088:0@lo:700: 00000100:00100000:2.0:1783969135.058046:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006e58d95b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099129216:0@lo:1000: 00000100:00100000:2.0:1783969135.058075:0:7748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969135.058098:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set 0000000065ed0f6d going to sleep for 11 seconds 00000100:00100000:3.0:1783969135.059827:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099129216 00000100:00100000:3.0:1783969135.059840:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099129216 00000100:00100000:3.0:1783969135.059893:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969135.059902:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b3fa06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1870627099129216:12345-0@lo:1000: 00000100:00100000:3.0:1783969135.059999:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b3fa06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1870627099129216:12345-0@lo:1000: Request processed in 99us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969135.060020:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783969135.060086:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006e58d95b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099129216:0@lo:1000: 00000004:00080000:2.0:1783969135.060145:0:7748:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000af85e00f with version 0 00000020:00100000:2.0:1783969135.060162:0:7748:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783969135.060168:0:7748:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006e58d95b x1870627099129472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969135.060186:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006e58d95b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099129472:0@lo:1000: 00000100:00100000:2.0:1783969135.060217:0:7748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969135.060242:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set 0000000040a07b14 going to sleep for 11 seconds 00000100:00100000:2.0:1783969135.060255:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099129472 00000100:00100000:2.0:1783969135.060258:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099129472 00000100:00100000:2.0:1783969135.060275:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783969135.060287:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f29c99e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7748:x1870627099129472:12345-0@lo:1000: 00000001:00080000:0.0:1783969135.068460:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1783969135.068473:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783969135.068857:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f29c99e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7748:x1870627099129472:12345-0@lo:1000: Request processed in 8566us (8636us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783969135.068870:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1783969135.068967:0:7748:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1783969135.068972:0:7748:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783969135.068987:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006e58d95b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099129472:0@lo:1000: 00000100:00100000:3.0:1783969135.069077:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002cdb52d6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099129600:0@lo:1000: 00000100:00100000:3.0:1783969135.069115:0:7748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969135.069159:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c369683f going to sleep for 11 seconds 00000100:00100000:0.0:1783969135.069224:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099129600 00000100:00100000:0.0:1783969135.069231:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099129600 00000100:00100000:0.0:1783969135.069272:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783969135.069279:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069c9226e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7748:x1870627099129600:12345-0@lo:1000: 00000100:00100000:0.0:1783969135.069349:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069c9226e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7748:x1870627099129600:12345-0@lo:1000: Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969135.069355:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969135.069489:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002cdb52d6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1870627099129600:0@lo:1000: 00000040:00080000:3.0:1783969135.069655:0:7748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783969135.069686:0:7748:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000044ef5880 with version 1 00000004:00080000:2.0:1783969135.070669:0:7746:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003993c3bd version 1 rpc_version 1 00000020:00100000:2.0:1783969135.070694:0:7746:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783969135.070702:0:7746:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006e58d95b x1870627099129856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969135.070720:0:7746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006e58d95b pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7746:1870627099129856:0@lo:1000: 00000100:00100000:2.0:1783969135.070774:0:7746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969135.070793:0:7746:0:(client.c:2702:ptlrpc_set_wait()) set 0000000052079d97 going to sleep for 11 seconds 00000100:00100000:0.0:1783969135.071021:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099129856 00000100:00100000:0.0:1783969135.071028:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099129856 00000100:00100000:0.0:1783969135.071075:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969135.071082:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081d9022d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7746:x1870627099129856:12345-0@lo:1000: 00000040:00080000:3.0:1783969135.074876:0:7748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783969135.074946:0:7748:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783969135.074950:0:7748:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1783969135.082007:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1783969135.082171:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081d9022d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7746:x1870627099129856:12345-0@lo:1000: Request processed in 11087us (11394us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783969135.082186:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1783969135.082260:0:7746:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1783969135.082265:0:7746:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783969135.082280:0:7746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006e58d95b pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7746:1870627099129856:0@lo:1000: 00010000:00010000:3.0:1783969135.409549:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783969135.532608:0:7779:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969135.532807:0:7779:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783969136.432812:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969137.456789:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969138.484837:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783969138.831827:0:7880:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783969138.832124:0:7880:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783969139.507421:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969139.568707:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e18343b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099129984:0@lo:41: 00000100:00100000:1.0:1783969139.568779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969139.568894:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099129984 00000100:00100000:2.0:1783969139.568902:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099129984 00000100:00100000:2.0:1783969139.568952:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783969139.568960:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008896be83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099129984:12345-0@lo:41: 00000004:00000024:2.0:1783969139.568991:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1783969139.569033:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008896be83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099129984:12345-0@lo:41: Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969139.569040:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783969139.569115:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e18343b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099129984:0@lo:41: 00000020:00000080:1.0:1783969139.849865:0:7928:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7e32e960 20000000:00000080:1.0:1783969139.849883:0:7928:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93eab9f11400 uarg=0000000000000000 20000000:01000000:1.0:1783969139.849922:0:7928:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783969139.849929:0:7928:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783969139.849934:0:7928:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783969139.850020:0:7928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1783969139.850032:0:7928:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1783969139.862118:0:7928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969139.862398:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783969139.862437:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1783969139.862463:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1783969139.862480:0:7928:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783969139.862497:0:7928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969139.862516:0:7928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9674 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969139.862524:0:7928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9762 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969139.862530:0:7928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969139.862567:0:7928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9762 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969139.862579:0:7928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9762 expref: 17 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969139.862593:0:7928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1870627099130112:0@lo:104: 00000100:00100000:2.0:1783969139.862660:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969139.862721:0:7928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9674 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969139.862729:0:7928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9674 expref: 17 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969139.862736:0:7928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000cf421eb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1870627099130240:0@lo:104: 00000100:00100000:2.0:1783969139.862752:0:7928:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f8dea077 going to sleep for 11 seconds 00000100:00100000:0.0:1783969139.862826:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783969139.862842:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969139.862862:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099130240 00000100:00100000:0.0:1783969139.862862:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099130112 00000100:00100000:1.0:1783969139.862868:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099130240 00000100:00100000:0.0:1783969139.862868:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099130112 00000100:00100000:1.0:1783969139.866141:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783969139.866163:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081055596 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:7928:x1870627099130240:12345-0@lo:104: 00010000:00010000:1.0:1783969139.866180:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969139.866261:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969139.866266:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081055596 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:7928:x1870627099130240:12345-0@lo:104: Request processed in 113us (3424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969139.866272:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969139.866596:0:7928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000cf421eb pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1870627099130240:0@lo:104: 00000100:00100000:0.0:1783969139.867406:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969139.867417:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b6ca339 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:7928:x1870627099130112:12345-0@lo:104: 00010000:00010000:0.0:1783969139.867429:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867489:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969139.867494:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b6ca339 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:7928:x1870627099130112:12345-0@lo:104: Request processed in 81us (4836us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969139.867500:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1783969139.867543:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969139.867548:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867555:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000052647a54 already unused, calling callback (000000006c6f1bb4) 10000000:00010000:0.0:1783969139.867558:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867575:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969139.867581:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969139.867586:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969139.867617:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867624:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969139.867642:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867648:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 0000000052647a54/0xea31253a47cb9674 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb967b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867659:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969139.867661:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867666:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000afa81da2 already unused, calling callback (000000006c6f1bb4) 10000000:00010000:0.0:1783969139.867668:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867674:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969139.867679:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969139.867691:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969139.867704:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867709:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969139.867714:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867719:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 00000000afa81da2/0xea31253a47cb9762 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9769 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969139.867732:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969139.867733:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969139.867735:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969139.867748:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f80878a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099130368:0@lo:103: 00000100:00100000:0.0:1783969139.867784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969139.867823:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969139.867829:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b2676050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099130496:0@lo:103: 00000100:00100000:0.0:1783969139.867864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969139.867899:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969139.868074:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099130368 00000100:00100000:3.0:1783969139.868081:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099130368 00010000:00010000:3.0:1783969139.868104:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9674 expref: 18 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969139.868130:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099130496 00000100:00100000:3.0:1783969139.868133:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099130496 00010000:00010000:3.0:1783969139.868141:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9762 expref: 19 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969139.868166:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969139.868172:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007efa0af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:3646:x1870627099130368:12345-0@lo:103: 00010000:00010000:3.0:1783969139.868183:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969139.868188:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9674 expref: 19 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868195:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9674 expref: 19 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868207:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019d2d596/0xea31253a47cb967b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9674 expref: 19 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868220:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969139.868242:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783969139.868250:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007efa0af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3646:x1870627099130368:12345-0@lo:103: Request processed in 79us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969139.868250:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1783969139.868256:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969139.868266:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969139.868270:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002156286 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:3646:x1870627099130496:12345-0@lo:103: 00010000:00010000:3.0:1783969139.868277:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969139.868280:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9762 expref: 17 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969139.868280:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f80878a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099130368:0@lo:103: 00010000:00010000:3.0:1783969139.868289:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9762 expref: 17 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868300:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868317:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868345:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868351:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868357:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868362:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868366:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aa8def55 already unused, calling callback (00000000fc97f683) 00010000:00010000:3.0:1783969139.868369:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868375:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868565:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969139.868576:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969139.868611:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002156286 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:3646:x1870627099130496:12345-0@lo:103: Request processed in 340us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969139.868617:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969139.868632:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b2676050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099130496:0@lo:103: 00010000:00010000:2.0:1783969139.868831:0:7928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000064935844/0xea31253a47cb9769 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9762 expref: 16 pid: 6515 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969139.868847:0:7928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075ce0356 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1870627099130112:0@lo:104: 00010000:00010000:2.0:1783969139.868864:0:7928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969139.868872:0:7928:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969139.868877:0:7928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969139.868882:0:7928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aa8def55/0xea31253a47cb97fc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969140.083954:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000008c21c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099130752:0@lo:400: 00000100:00100000:0.0:1783969140.084037:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969140.084090:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783969140.084106:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d59b87b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099130624:0@lo:400: 00000100:00100000:0.0:1783969140.084145:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969140.084171:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000008e5b406 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099131136:0@lo:400: 00000100:00100000:0.0:1783969140.084195:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969140.084219:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e40b6917 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099130880:0@lo:400: 00000100:00100000:0.0:1783969140.084240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969140.084257:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969140.084262:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002a67aa9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099131008:0@lo:400: 00000100:00100000:0.0:1783969140.084282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969140.084309:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099130752 00000100:00100000:0.0:1783969140.084326:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099130752 00000100:00100000:0.0:1783969140.084368:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099131008 00000100:00100000:0.0:1783969140.084372:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099131008 00000100:00100000:0.0:1783969140.084416:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969140.084424:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ab5bb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099130752:12345-0@lo:400: 00000100:00100000:0.0:1783969140.084471:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ab5bb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099130752:12345-0@lo:400: Request processed in 48us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969140.084479:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969140.084495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969140.084500:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db70c710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099131008:12345-0@lo:400: 00000100:00100000:0.0:1783969140.084528:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db70c710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099131008:12345-0@lo:400: Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969140.084534:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969140.084551:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099131136 00000100:00100000:0.0:1783969140.084554:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099131136 00000100:00100000:0.0:1783969140.084569:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099130880 00000100:00100000:0.0:1783969140.084571:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099130880 00000100:00100000:0.0:1783969140.084582:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783969140.084593:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e3866a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099131136:12345-0@lo:400: 00000100:00100000:0.0:1783969140.084624:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e3866a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099131136:12345-0@lo:400: Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969140.084629:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783969140.084641:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969140.084646:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d16b314c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099130880:12345-0@lo:400: 00000100:00100000:0.0:1783969140.084668:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d16b314c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099130880:12345-0@lo:400: Request processed in 23us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969140.084674:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1783969140.084721:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002a67aa9b x1870627099131008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969140.084733:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002a67aa9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099131008:0@lo:400: 00000100:00100000:0.0:1783969140.084744:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e40b6917 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099130880:0@lo:400: 00000100:00100000:0.0:1783969140.084775:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000008e5b406 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099131136:0@lo:400: 00010000:00080000:0.0:1783969140.084783:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000008c21c88 x1870627099130752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969140.084791:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000008c21c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099130752:0@lo:400: 00000100:00100000:3.0:1783969140.085151:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099130624 00000100:00100000:3.0:1783969140.085162:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099130624 00000100:00100000:3.0:1783969140.085189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783969140.085194:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dc11693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3649:x1870627099130624:12345-0@lo:400: 00000100:00100000:3.0:1783969140.085232:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dc11693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3649:x1870627099130624:12345-0@lo:400: Request processed in 38us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969140.085238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783969140.087607:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969140.087627:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002cdb52d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099131264:0@lo:41: 00000100:00100000:1.0:1783969140.087683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969140.087724:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099131264 00000100:00100000:1.0:1783969140.087730:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099131264 00000100:00100000:1.0:1783969140.087763:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969140.087769:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a140ffe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099131264:12345-0@lo:41: 00000004:00000024:1.0:1783969140.087798:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783969140.087834:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a140ffe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099131264:12345-0@lo:41: Request processed in 66us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969140.087841:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969140.087875:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002cdb52d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099131264:0@lo:41: 00000100:00100000:0.0:1783969140.090293:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d59b87b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099130624:0@lo:400: 00010000:00010000:3.0:1783969140.533808:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783969140.919217:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969140.919225:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab929d800 from 1 10000000:01000000:3.0:1783969140.919228:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969140.919268:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000007380d9a4/0xea31253a47cb9803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969140.919281:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000007380d9a4/0xea31253a47cb9803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969140.919292:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000007380d9a4/0xea31253a47cb9803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969140.919327:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000115d8f7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099131392:0@lo:101: 00000100:00100000:3.0:1783969140.919427:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969140.919483:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cef62c1e going to sleep for 11 seconds 00000100:00100000:0.0:1783969140.919916:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099131392 00000100:00100000:0.0:1783969140.919924:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099131392 00000100:00100000:0.0:1783969140.919968:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783969140.919973:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099131392:12345-0@lo:101: 00010000:00010000:0.0:1783969140.919984:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969140.919996:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019d2d596/0xea31253a47cb980a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9803 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969140.920021:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019d2d596/0xea31253a47cb980a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9803 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969140.920028:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019d2d596/0xea31253a47cb980a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9803 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969140.920035:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019d2d596, rc 0) 00000100:00100000:0.0:1783969140.920084:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099131392:12345-0@lo:101: Request processed in 110us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969140.920090:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783969140.920294:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000115d8f7c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099131392:0@lo:101: 00010000:00010000:1.0:1783969140.920319:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000007380d9a4/0xea31253a47cb9803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969140.920334:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000007380d9a4/0xea31253a47cb9803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969140.920438:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000709a92b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099131520:0@lo:501: 00000100:00100000:1.0:1783969140.920472:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969140.920502:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000006c798b82 going to sleep for 11 seconds 00000100:00100000:0.0:1783969140.920823:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099131520 00000100:00100000:0.0:1783969140.920827:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099131520 00000100:00100000:0.0:1783969140.920853:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783969140.920857:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff133b26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099131520:12345-0@lo:501: 00000100:00100000:0.0:1783969140.920943:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff133b26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099131520:12345-0@lo:501: Request processed in 86us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969140.920948:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783969140.921035:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000709a92b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099131520:0@lo:501: 00000100:00100000:1.0:1783969140.921062:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000709a92b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099131648:0@lo:503: 00000100:00100000:1.0:1783969140.921102:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969140.921131:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000006c798b82 going to sleep for 11 seconds 00000100:00100000:3.0:1783969140.921480:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099131648 00000100:00100000:3.0:1783969140.921493:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099131648 00000100:00100000:3.0:1783969140.921523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969140.921529:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf38152d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099131648:12345-0@lo:503: 00000100:00100000:3.0:1783969140.921624:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf38152d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099131648:12345-0@lo:503: Request processed in 84us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969140.921631:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969140.921678:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000709a92b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099131648:0@lo:503: 00000100:00100000:3.0:1783969140.921852:0:7960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000115d8f7c pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7960:1870627099131776:0@lo:502: 00000100:00100000:3.0:1783969140.921882:0:7960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969140.921899:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099131776 00000100:00100000:3.0:1783969140.921902:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099131776 00000100:00100000:3.0:1783969140.921920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783969140.921926:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000887c9694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:7960:x1870627099131776:12345-0@lo:502: 00000100:00100000:3.0:1783969140.921998:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000887c9694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:7960:x1870627099131776:12345-0@lo:502: Request processed in 72us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969140.922004:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783969140.922036:0:7960:0:(client.c:2702:ptlrpc_set_wait()) set 000000005cff31eb going to sleep for 11 seconds 00000100:00100000:3.0:1783969140.922047:0:7960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000115d8f7c pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7960:1870627099131776:0@lo:502: 00000020:01000000:3.0:1783969140.922064:0:7960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969140.922073:0:7960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969140.922075:0:7960:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783969140.922083:0:7960:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93eab929d800 00000020:00000080:3.0:1783969140.922085:0:7960:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783969140.922129:0:7960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7960:1870627099131904:0@lo:502: 00000100:00100000:3.0:1783969140.922161:0:7960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969140.922791:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099131904 00000100:00100000:0.0:1783969140.922796:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099131904 00000100:00100000:0.0:1783969140.922824:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783969140.922831:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:7960:x1870627099131904:12345-0@lo:502: 00000100:00100000:0.0:1783969140.922908:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:7960:x1870627099131904:12345-0@lo:502: Request processed in 77us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969140.922914:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783969140.924555:0:7960:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea85fa7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969140.924587:0:7960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7960:1870627099131904:0@lo:502: 00000020:01000000:3.0:1783969140.924631:0:7960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969140.924639:0:7960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969140.924641:0:7960:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783969140.924645:0:7960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1783969140.926889:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783969140.926921:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969140.926932:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969140.926952:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969140.926974:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783969140.926977:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ea912c9800 from 1 10000000:01000000:0.0:1783969140.926980:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969140.927015:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969140.927024:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969140.927034:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969140.927056:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7212300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099132032:0@lo:101: 00000100:00100000:0.0:1783969140.927131:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969140.927174:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8b09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969140.927361:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099132032 00000100:00100000:1.0:1783969140.927368:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099132032 00000100:00100000:1.0:1783969140.927444:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783969140.927453:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099132032:12345-0@lo:101: 00010000:00010000:1.0:1783969140.927465:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969140.927478:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9811 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969140.927509:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9811 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969140.927520:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9811 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969140.927529:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600200, rc 0) 00000100:00100000:1.0:1783969140.927564:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099132032:12345-0@lo:101: Request processed in 112us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969140.927578:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783969140.927809:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7212300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099132032:0@lo:101: 00010000:00010000:0.0:1783969140.927822:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969140.927830:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969140.927896:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7212300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099132160:0@lo:501: 00000100:00100000:0.0:1783969140.927922:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969140.927943:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8b09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969140.929464:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099132160 00000100:00100000:2.0:1783969140.929472:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099132160 00000100:00100000:2.0:1783969140.929517:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783969140.929526:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099132160:12345-0@lo:501: 00000100:00100000:2.0:1783969140.929667:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099132160:12345-0@lo:501: Request processed in 142us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969140.929674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783969140.929721:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7212300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099132160:0@lo:501: 00000100:00100000:2.0:1783969140.929762:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099132288:0@lo:503: 00000100:00100000:2.0:1783969140.929803:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969140.929826:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea89d7ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969140.929837:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099132288 00000100:00100000:2.0:1783969140.929840:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099132288 00000100:00100000:2.0:1783969140.929856:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783969140.929868:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099132288:12345-0@lo:503: 00000100:00100000:2.0:1783969140.929934:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099132288:12345-0@lo:503: Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969140.929941:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783969140.929989:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099132288:0@lo:503: 00000100:00100000:2.0:1783969140.931229:0:7962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7962:1870627099132416:0@lo:502: 00000100:00100000:2.0:1783969140.931280:0:7962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969140.931702:0:7962:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1783969140.939642:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099132416 00000100:00100000:0.0:1783969140.939658:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099132416 00000100:00100000:0.0:1783969140.939727:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783969140.939739:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:7962:x1870627099132416:12345-0@lo:502: 00000100:00100000:0.0:1783969140.939905:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:7962:x1870627099132416:12345-0@lo:502: Request processed in 168us (8624us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969140.939914:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783969140.940094:0:7962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7962:1870627099132416:0@lo:502: 00000020:01000000:2.0:1783969140.940130:0:7962:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969140.940139:0:7962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969140.940142:0:7962:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783969140.940149:0:7962:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ea912c9800 00000020:00000080:2.0:1783969140.940152:0:7962:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783969140.940188:0:7962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7962:1870627099132544:0@lo:502: 00000100:00100000:2.0:1783969140.940232:0:7962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969140.940270:0:7962:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1783969140.940601:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099132544 00000100:00100000:0.0:1783969140.940606:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099132544 00000100:00100000:0.0:1783969140.940650:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783969140.940658:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:7962:x1870627099132544:12345-0@lo:502: 00000100:00100000:0.0:1783969140.940731:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:7962:x1870627099132544:12345-0@lo:502: Request processed in 74us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969140.940738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783969140.940862:0:7962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:7962:1870627099132544:0@lo:502: 00000020:01000000:2.0:1783969140.940882:0:7962:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969140.940887:0:7962:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969140.940889:0:7962:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783969140.940892:0:7962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1783969140.941639:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783969140.941665:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969140.941676:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969140.941688:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969141.555000:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969142.576837:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969143.608680:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969144.626005:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969144.691850:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099132672:0@lo:41: 00000100:00100000:1.0:1783969144.691958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969144.692082:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099132672 00000100:00100000:1.0:1783969144.692092:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099132672 00000100:00100000:1.0:1783969144.692159:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783969144.692169:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099132672:12345-0@lo:41: 00000004:00000024:1.0:1783969144.692219:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1783969144.692286:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099132672:12345-0@lo:41: Request processed in 118us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969144.692294:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783969144.692564:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099132672:0@lo:41: 00000100:00100000:0.0:1783969145.200737:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099133184:0@lo:400: 00000100:00100000:0.0:1783969145.200833:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969145.200903:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783969145.203150:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099132800:0@lo:400: 00000100:00100000:0.0:1783969145.203271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969145.203720:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099132800 00000100:00100000:2.0:1783969145.203732:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099132800 00000100:00100000:2.0:1783969145.203795:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783969145.203807:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3646:x1870627099132800:12345-0@lo:400: 00000100:00100000:2.0:1783969145.203879:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3646:x1870627099132800:12345-0@lo:400: Request processed in 74us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969145.203887:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783969145.204793:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099132800:0@lo:400: 00000100:00100000:0.0:1783969145.204808:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099133312:0@lo:400: 00000100:00100000:0.0:1783969145.204854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969145.205018:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099133312 00000100:00100000:2.0:1783969145.205026:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099133312 00000100:00100000:2.0:1783969145.205071:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783969145.205079:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099133312:12345-0@lo:400: 00000100:00100000:2.0:1783969145.205130:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099133312:12345-0@lo:400: Request processed in 51us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969145.205137:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783969145.205770:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099133312:0@lo:400: 00000100:00100000:0.0:1783969145.205800:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099132928:0@lo:400: 00000100:00100000:0.0:1783969145.205840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969145.209427:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099133440:0@lo:41: 00000100:00100000:0.0:1783969145.209515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969145.209552:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969145.209560:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099133056:0@lo:400: 00000100:00100000:0.0:1783969145.209586:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969145.209688:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099133440 00000100:00100000:1.0:1783969145.209699:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099133440 00000100:00100000:1.0:1783969145.209751:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099133056 00000100:00100000:1.0:1783969145.209755:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099133056 00000100:00100000:1.0:1783969145.209772:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969145.209782:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099133440:12345-0@lo:41: 00000004:00000024:1.0:1783969145.209830:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783969145.209888:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099133440:12345-0@lo:41: Request processed in 107us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969145.209896:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969145.209915:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783969145.209921:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099133056:12345-0@lo:400: 00000100:00100000:1.0:1783969145.209953:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099133056:12345-0@lo:400: Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969145.209979:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783969145.210035:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099133056:0@lo:400: 00000100:00100000:1.0:1783969145.210054:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099133440:0@lo:41: 00000100:00100000:2.0:1783969145.211756:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099133184 00000100:00100000:2.0:1783969145.211770:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099133184 00000100:00100000:2.0:1783969145.211830:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099132928 00000100:00100000:2.0:1783969145.211835:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099132928 00000100:00100000:2.0:1783969145.211859:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969145.211870:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099133184:12345-0@lo:400: 00000100:00100000:2.0:1783969145.211964:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099133184:12345-0@lo:400: Request processed in 96us (11131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969145.211972:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969145.211992:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783969145.211999:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099132928:12345-0@lo:400: 00000100:00100000:2.0:1783969145.212032:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099132928:12345-0@lo:400: Request processed in 34us (6192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969145.212038:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1783969145.212335:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93eab7211500 x1870627099132928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969145.212351:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099132928:0@lo:400: 00010000:00080000:0.0:1783969145.218629:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93eab7210700 x1870627099133184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969145.218653:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099133184:0@lo:400: 00010000:00010000:3.0:1783969145.650556:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969146.675687:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969147.697524:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969148.724465:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969149.745120:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969149.809216:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099133568:0@lo:41: 00000100:00100000:0.0:1783969149.809304:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969149.809425:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099133568 00000100:00100000:1.0:1783969149.809434:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099133568 00000100:00100000:1.0:1783969149.809485:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969149.809494:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099133568:12345-0@lo:41: 00000004:00000024:1.0:1783969149.809528:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1783969149.809575:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099133568:12345-0@lo:41: Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969149.809581:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969149.809628:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099133568:0@lo:41: 00000100:00100000:1.0:1783969150.320610:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969150.320634:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099133696:0@lo:41: 00000100:00100000:1.0:1783969150.320696:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969150.320752:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099133696 00000100:00100000:1.0:1783969150.320759:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099133696 00000100:00100000:1.0:1783969150.320804:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969150.320812:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099133696:12345-0@lo:41: 00000004:00000024:1.0:1783969150.320846:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783969150.320891:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099133696:12345-0@lo:41: Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969150.320912:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969150.320955:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099133696:0@lo:41: 00000100:00100000:0.0:1783969150.321537:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099134208:0@lo:400: 00000100:00100000:0.0:1783969150.321582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969150.321610:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969150.321616:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099133824:0@lo:400: 00000100:00100000:0.0:1783969150.321647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969150.321686:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099133952:0@lo:400: 00000100:00100000:0.0:1783969150.321712:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969150.321726:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969150.321730:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099134080:0@lo:400: 00000100:00100000:0.0:1783969150.321750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969150.321771:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099134208 00000100:00100000:0.0:1783969150.321775:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099134208 00000100:00100000:0.0:1783969150.321802:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099133952 00000100:00100000:0.0:1783969150.321805:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099133952 00000100:00100000:0.0:1783969150.321821:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969150.321828:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099134208:12345-0@lo:400: 00000100:00100000:0.0:1783969150.321867:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099134208:12345-0@lo:400: Request processed in 39us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969150.321943:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969150.321957:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969150.321962:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099133952:12345-0@lo:400: 00000100:00100000:0.0:1783969150.321994:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099133952:12345-0@lo:400: Request processed in 32us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969150.321999:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969150.322015:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099133824 00000100:00100000:0.0:1783969150.322018:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099133824 00000100:00100000:3.0:1783969150.322821:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783969150.322833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3646:x1870627099133824:12345-0@lo:400: 00000100:00100000:3.0:1783969150.322872:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3646:x1870627099133824:12345-0@lo:400: Request processed in 43us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969150.322878:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1783969150.325376:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93eab7212d80 x1870627099133952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969150.325408:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099133952:0@lo:400: 00000100:00100000:0.0:1783969150.325452:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099133824:0@lo:400: 00010000:00080000:0.0:1783969150.325465:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93eab7213800 x1870627099134208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969150.325496:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099134208:0@lo:400: 00000100:00100000:1.0:1783969150.326265:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099134080 00000100:00100000:1.0:1783969150.326274:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099134080 00000100:00100000:1.0:1783969150.326319:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969150.326328:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099134080:12345-0@lo:400: 00000100:00100000:1.0:1783969150.326441:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099134080:12345-0@lo:400: Request processed in 114us (4689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969150.326448:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969150.326486:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099134080:0@lo:400: 00010000:00010000:0.0:1783969150.768765:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969151.792770:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783969151.977557:0:8430:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783969151.977561:0:8430:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783969151.977563:0:8430:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783969151.977711:0:8430:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93eab70d7000 00000020:01000004:3.0:1783969151.977725:0:8430:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783969151.977739:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783969151.977753:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93eab920b380) 00000020:00000080:3.0:1783969151.977769:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783969152.052116:0:8430:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1783969152.052959:0:8430:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1783969152.068101:0:8430:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783969152.068483:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1783969152.068495:0:8430:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783969152.068507:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xea31253a47cb9826 00000020:01000004:1.0:1783969152.068513:0:8430:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783969152.068534:0:8430:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783969152.068537:0:8430:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783969152.068543:0:8430:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1783969152.068547:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1783969152.068568:0:8430:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93eab755cd40) 00000020:00000080:1.0:1783969152.068581:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1783969152.070432:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969152.070582:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1783969152.070588:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783969152.075471:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783969152.075483:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783969152.078024:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783969152.079361:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783969152.086772:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969152.086939:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783969152.086945:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783969152.088437:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783969152.088446:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783969152.148147:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969152.148415:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783969152.148421:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783969152.156417:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783969152.158234:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783969152.160134:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783969152.160148:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1783969152.173148:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969152.173548:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1783969152.173568:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783969152.179066:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783969152.179080:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1783969152.317458:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969152.318326:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1783969152.318336:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783969152.329189:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783969152.329266:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783969152.329915:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783969152.329946:0:8430:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783969152.329953:0:8430:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783969152.389368:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783969152.391652:0:8430:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1783969152.391659:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783969152.391661:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969152.391662:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969152.391663:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969152.391665:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969152.391666:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969152.391668:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969152.391669:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969152.391671:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969152.391673:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969152.391674:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969152.391678:0:8430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1783969152.391743:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783969152.391745:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969152.391747:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969152.391748:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969152.391749:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969152.391750:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969152.391751:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969152.391752:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969152.391753:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969152.391754:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969152.391755:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969152.391783:0:8430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783969152.391801:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099134336:0@lo:253: 00000100:00100000:2.0:1783969152.391867:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.391958:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83e3bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969152.392007:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099134336 00000100:00100000:1.0:1783969152.392014:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099134336 00000100:00100000:1.0:1783969152.392163:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783969152.392174:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:8430:x1870627099134336:12345-0@lo:253: 20000000:01000000:1.0:1783969152.392215:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783969152.392219:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1783969152.392224:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1783969152.392226:0:6515:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1783969152.392525:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969152.392698:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1783969152.392712:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1783969152.392729:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1783969152.392735:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1783969152.392747:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1783969152.392761:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1783969152.392855:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1783969152.392870:0:6515:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:1.0:1783969152.392872:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:1.0:1783969152.392886:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1783969152.392893:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783969152.392906:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1783969152.392911:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:1.0:1783969152.392925:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1783969152.392932:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783969152.392944:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1783969152.392959:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1783969152.393470:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1783969152.393486:0:6515:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:1.0:1783969152.393488:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:1.0:1783969152.393506:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1783969152.393511:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783969152.393524:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1783969152.393530:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:1.0:1783969152.393543:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1783969152.393548:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783969152.393560:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1783969152.393575:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1783969152.394253:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1783969152.394267:0:6515:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:1.0:1783969152.394269:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:1.0:1783969152.394283:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1783969152.394289:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783969152.394300:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1783969152.394305:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:1.0:1783969152.394317:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1783969152.394322:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783969152.395475:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1783969152.395760:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1783969152.395785:0:6515:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783969152.395788:0:6515:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783969152.395791:0:6515:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783969152.395841:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783969152.395844:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783969152.396668:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1783969152.396704:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1783969152.396717:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1783969152.396897:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1783969152.396919:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1783969152.396933:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1783969152.396944:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783969152.396946:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783969152.397339:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1783969152.397360:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1783969152.397373:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1783969152.397562:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1783969152.397592:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1783969152.397607:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1783969152.397615:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783969152.397617:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783969152.397939:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1783969152.397959:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1783969152.397974:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1783969152.398156:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1783969152.398173:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1783969152.398186:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1783969152.398194:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783969152.398195:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783969152.398502:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1783969152.398616:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1783969152.398632:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1783969152.398643:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1783969152.398660:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783969152.398751:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.398774:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb96f9 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.398782:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea9b601600/0xea31253a47cb9777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9770 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.398790:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea813a0000/0xea31253a47cb97af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb97a8 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.398797:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea80031200/0xea31253a47cb97cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb97c4 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.398803:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb97f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb97ee expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.398811:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.398859:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb97f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb97ee expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.398882:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb97f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb97ee expref: 18 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969152.398898:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134464:0@lo:104: 00000100:00100000:1.0:1783969152.398969:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969152.399072:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea80031200/0xea31253a47cb97cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb97c4 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.399081:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea80031200/0xea31253a47cb97cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb97c4 expref: 18 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969152.399090:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134592:0@lo:104: 00000100:00100000:1.0:1783969152.399112:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969152.399371:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea813a0000/0xea31253a47cb97af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb97a8 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.399409:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea813a0000/0xea31253a47cb97af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb97a8 expref: 18 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969152.399419:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134720:0@lo:104: 00000100:00100000:1.0:1783969152.399454:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.399491:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099134464 00000100:00100000:3.0:1783969152.399498:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099134464 00000100:00100000:0.0:1783969152.399675:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099134592 00000100:00100000:0.0:1783969152.399679:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099134592 00000100:00100000:0.0:1783969152.399713:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969152.399721:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6515:x1870627099134464:12345-0@lo:104: 00010000:00010000:0.0:1783969152.399752:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea813a0a00/0xea31253a47cb97ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.399940:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969152.399947:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6515:x1870627099134464:12345-0@lo:104: Request processed in 227us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969152.399955:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969152.399972:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783969152.399979:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6515:x1870627099134592:12345-0@lo:104: 00010000:00010000:0.0:1783969152.399986:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea80031a00/0xea31253a47cb97c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.400075:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea9b601600/0xea31253a47cb9777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9770 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.400084:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea9b601600/0xea31253a47cb9777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9770 expref: 18 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969152.400094:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134848:0@lo:104: 00000100:00100000:1.0:1783969152.400137:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969152.400154:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb96f9 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.400162:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9700 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb96f9 expref: 18 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969152.400170:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134976:0@lo:104: 00000100:00100000:1.0:1783969152.400189:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969152.400198:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ec8780 going to sleep for 11 seconds 00000100:00100000:1.0:1783969152.400218:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134464:0@lo:104: 00000100:00100000:1.0:1783969152.400226:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134592:0@lo:104: 00000100:00100000:3.0:1783969152.400334:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1783969152.400342:0:6505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1783969152.400571:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099134720 00000100:00100000:1.0:1783969152.400576:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099134720 00000100:00100000:1.0:1783969152.400596:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1783969152.400601:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099134848 00000100:00100000:1.0:1783969152.400603:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099134848 00000100:00100000:1.0:1783969152.400611:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1783969152.400614:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099134976 00000100:00100000:1.0:1783969152.400616:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099134976 00000100:00100000:3.0:1783969152.400747:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969152.400754:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:6515:x1870627099134720:12345-0@lo:104: 00010000:00010000:3.0:1783969152.400763:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb97a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969152.400845:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134720:0@lo:104: 00010000:00010000:2.0:1783969152.401967:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783969152.401978:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea813a0a00/0xea31253a47cb97ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.401988:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0a00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969152.401992:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a0a00/0xea31253a47cb97ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402016:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea813a0a00/0xea31253a47cb97ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969152.402024:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a0a00/0xea31253a47cb97ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969152.402030:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783969152.402089:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea813a0a00/0xea31253a47cb97ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402095:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969152.402116:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea813a0a00/0xea31253a47cb97ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402133:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea813a0a00/0xea31253a47cb97ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402147:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969152.402150:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea80031a00/0xea31253a47cb97c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402155:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80031a00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969152.402158:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea80031a00/0xea31253a47cb97c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402164:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea80031a00/0xea31253a47cb97c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969152.402171:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea80031a00/0xea31253a47cb97c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969152.402182:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783969152.402195:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea80031a00/0xea31253a47cb97c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402201:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969152.402211:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea80031a00/0xea31253a47cb97c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402218:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea80031a00/0xea31253a47cb97c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97cb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402229:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969152.402232:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb97a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402237:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600e00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969152.402240:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb97a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402247:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb97a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969152.402253:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb97a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969152.402258:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783969152.402271:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb97a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402277:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969152.402287:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb97a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402294:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb97a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97af expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.402304:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969152.402306:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969152.402307:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969152.402445:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099135104:0@lo:103: 00000100:00100000:1.0:1783969152.402495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969152.402543:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099135232:0@lo:103: 00000100:00100000:1.0:1783969152.402576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969152.402596:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969152.402602:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099135360:0@lo:103: 00000100:00100000:1.0:1783969152.402619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.402898:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099135104 00000100:00100000:2.0:1783969152.402906:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099135104 00010000:00010000:2.0:1783969152.402941:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb97f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb97ee expref: 19 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969152.402973:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099135232 00000100:00100000:2.0:1783969152.402976:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099135232 00010000:00010000:2.0:1783969152.402987:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea80031200/0xea31253a47cb97cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb97c4 expref: 20 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969152.402998:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099135360 00000100:00100000:2.0:1783969152.403000:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099135360 00010000:00010000:2.0:1783969152.403008:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea813a0000/0xea31253a47cb97af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb97a8 expref: 21 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969152.403019:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969152.403025:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3647:x1870627099135104:12345-0@lo:103: 00010000:00010000:2.0:1783969152.403055:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969152.403062:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb97f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb97ee expref: 21 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.403073:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb97f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb97ee expref: 21 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.403091:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb97f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb97ee expref: 21 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.403105:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969152.403146:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3647:x1870627099135104:12345-0@lo:103: Request processed in 121us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.403153:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969152.403170:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969152.403175:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:3648:x1870627099135232:12345-0@lo:103: 00010000:00010000:2.0:1783969152.403182:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969152.403186:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea80031200/0xea31253a47cb97cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb97c4 expref: 19 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.403194:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea80031200/0xea31253a47cb97cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb97c4 expref: 19 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.403203:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea80031200/0xea31253a47cb97cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb97c4 expref: 19 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.403212:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969152.403233:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3648:x1870627099135232:12345-0@lo:103: Request processed in 58us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.403239:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969152.403249:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783969152.403254:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:3648:x1870627099135360:12345-0@lo:103: 00010000:00010000:2.0:1783969152.403260:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969152.403264:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea813a0000/0xea31253a47cb97af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb97a8 expref: 17 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.403278:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea813a0000/0xea31253a47cb97af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb97a8 expref: 17 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.403287:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea813a0000/0xea31253a47cb97af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb97a8 expref: 17 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.403295:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969152.403315:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3648:x1870627099135360:12345-0@lo:103: Request processed in 61us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.403320:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969152.403477:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099135104:0@lo:103: 00000100:00100000:1.0:1783969152.403504:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099135360:0@lo:103: 00000100:00100000:1.0:1783969152.403511:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099135232:0@lo:103: 00010000:00010000:0.0:1783969152.403605:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1783969152.403613:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:6515:x1870627099134592:12345-0@lo:104: Request processed in 3634us (4499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969152.403621:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783969152.403639:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969152.403648:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:6515:x1870627099134848:12345-0@lo:104: 00010000:00010000:0.0:1783969152.403659:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea80030600/0xea31253a47cb9770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.403763:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969152.403820:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969152.403825:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:6515:x1870627099134848:12345-0@lo:104: Request processed in 180us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969152.403832:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969152.403846:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969152.403852:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6515:x1870627099134976:12345-0@lo:104: 00010000:00010000:0.0:1783969152.403867:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea813a0600/0xea31253a47cb96f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.403903:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969152.403908:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6515:x1870627099134976:12345-0@lo:104: Request processed in 57us (3719us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969152.403914:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783969152.403950:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969152.403955:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea80030600/0xea31253a47cb9770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.403962:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80030600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969152.403966:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea80030600/0xea31253a47cb9770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.403973:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea80030600/0xea31253a47cb9770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969152.403980:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea80030600/0xea31253a47cb9770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969152.403985:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969152.404013:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea80030600/0xea31253a47cb9770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.404019:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969152.404029:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea80030600/0xea31253a47cb9770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969152.404138:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134848:0@lo:104: 00000100:00100000:1.0:1783969152.404146:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6515:1870627099134976:0@lo:104: 00010000:00010000:1.0:1783969152.404170:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.404212:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969152.404352:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea80030600/0xea31253a47cb9770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9777 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.404372:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969152.404374:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969152.404376:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969152.404428:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099135488:0@lo:103: 00000100:00100000:0.0:1783969152.404457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969152.404493:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099135488 00000100:00100000:0.0:1783969152.404497:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099135488 00010000:00010000:0.0:1783969152.404514:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea9b601600/0xea31253a47cb9777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9770 expref: 16 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969152.404534:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969152.404540:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3646:x1870627099135488:12345-0@lo:103: 00010000:00010000:0.0:1783969152.404548:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969152.404552:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea9b601600/0xea31253a47cb9777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9770 expref: 16 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.404561:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea9b601600/0xea31253a47cb9777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9770 expref: 16 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.404572:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601600/0xea31253a47cb9777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9770 expref: 16 pid: 6516 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.404581:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969152.404960:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3646:x1870627099135488:12345-0@lo:103: Request processed in 419us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969152.404968:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783969152.405205:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099135488:0@lo:103: 00010000:00010000:2.0:1783969152.405302:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969152.405306:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969152.405308:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969152.405340:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea813a0600/0xea31253a47cb96f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405359:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969152.405362:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a0600/0xea31253a47cb96f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405369:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea813a0600/0xea31253a47cb96f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969152.405375:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a0600/0xea31253a47cb96f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969152.405502:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969152.405561:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea813a0600/0xea31253a47cb96f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405568:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969152.405589:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea813a0600/0xea31253a47cb96f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405604:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea813a0600/0xea31253a47cb96f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9700 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405617:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969152.405619:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969152.405621:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969152.405627:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969152.405636:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099135616:0@lo:103: 00000100:00100000:0.0:1783969152.405671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969152.405711:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099135616 00000100:00100000:0.0:1783969152.405716:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099135616 00010000:00010000:0.0:1783969152.405739:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9700 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb96f9 expref: 15 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969152.405759:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969152.405765:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaac72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3646:x1870627099135616:12345-0@lo:103: 00010000:00010000:0.0:1783969152.405776:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969152.405780:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9700 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb96f9 expref: 15 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405790:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb96f9 expref: 15 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405801:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb96f9 expref: 15 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405815:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405824:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405839:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405846:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405853:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405859:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405875:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969152.405880:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405887:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405901:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.405910:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969152.405940:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaac72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:3646:x1870627099135616:12345-0@lo:103: Request processed in 175us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969152.405947:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969152.405998:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099135616:0@lo:103: 00010000:00010000:0.0:1783969152.406016:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.406023:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.406029:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9834 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783969152.406192:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1783969152.406936:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1783969152.406946:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6515:x1870627099134720:12345-0@lo:104: Request processed in 6190us (7490us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.406954:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969152.408556:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:8430:x1870627099134336:12345-0@lo:253: Request processed in 16379us (16683us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.408568:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783969152.408726:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099134336:0@lo:253: 10000000:01000000:2.0:1783969152.408739:0:8430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783969152.408742:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969152.408744:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969152.408746:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969152.408747:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1783969152.408748:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969152.408750:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969152.408751:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969152.408752:0:8430:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783969152.408753:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969152.408755:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783969152.408772:0:8430:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93eab70d7000 from lustre-OST0000 10000000:01000000:2.0:1783969152.408799:0:8430:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783969152.408801:0:8430:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783969152.408809:0:8430:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93eaa5b00000 local copy 10000000:01000000:2.0:1783969152.408812:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783969152.408850:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.408861:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.408870:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969152.408887:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099135744:0@lo:101: 00000100:00100000:2.0:1783969152.408921:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.408951:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074480 going to sleep for 11 seconds 00000100:00100000:0.0:1783969152.409265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099135744 00000100:00100000:0.0:1783969152.409271:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099135744 00000100:00100000:0.0:1783969152.409322:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783969152.409330:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+13:8430:x1870627099135744:12345-0@lo:101: 00010000:00010000:0.0:1783969152.409350:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969152.409362:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdf600/0xea31253a47cb9842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb983b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.409407:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdf600/0xea31253a47cb9842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb983b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.409418:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdf600/0xea31253a47cb9842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb983b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.409426:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf600, rc 0) 00000100:00100000:0.0:1783969152.409460:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:8430:x1870627099135744:12345-0@lo:101: Request processed in 131us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969152.409466:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783969152.409563:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099135744:0@lo:101: 00010000:00010000:2.0:1783969152.409576:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.409585:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969152.409973:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099135872:0@lo:501: 00000100:00100000:2.0:1783969152.410011:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.410046:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074480 going to sleep for 11 seconds 00000100:00100000:3.0:1783969152.410176:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099135872 00000100:00100000:3.0:1783969152.410181:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099135872 00000100:00100000:3.0:1783969152.410222:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783969152.410229:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:8430:x1870627099135872:12345-0@lo:501: 00000100:00100000:3.0:1783969152.410291:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:8430:x1870627099135872:12345-0@lo:501: Request processed in 63us (280us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783969152.410298:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783969152.410617:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099135872:0@lo:501: 10000000:01000000:2.0:1783969152.410632:0:8430:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783969152.410652:0:8430:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783969152.410658:0:8430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.410667:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.410893:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.410919:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783969152.410943:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93eab70d7000 10000000:01000000:2.0:1783969152.410948:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783969152.410953:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783969152.410956:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783969152.410959:0:8430:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783969152.410962:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783969152.410996:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.411004:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.411012:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969152.411026:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136000:0@lo:101: 00000100:00100000:2.0:1783969152.411069:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.411096:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969152.411214:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099136000 00000100:00100000:3.0:1783969152.411219:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099136000 00000100:00100000:3.0:1783969152.411251:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783969152.411258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:8430:x1870627099136000:12345-0@lo:101: 00010000:00010000:3.0:1783969152.411267:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969152.411278:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9849 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.411296:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9849 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.411306:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9849 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.411336:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2176800, rc 0) 00000100:00100000:3.0:1783969152.411367:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136000:12345-0@lo:101: Request processed in 109us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.411372:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783969152.412020:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136000:0@lo:101: 00010000:00010000:2.0:1783969152.412105:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.412116:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969152.412229:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136128:0@lo:501: 00000100:00100000:2.0:1783969152.412267:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.412301:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1783969152.412404:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969152.412411:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.412419:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a1a00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:1.0:1783969152.412423:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.412431:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969152.412438:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969152.412443:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783969152.412464:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.412479:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969152.412499:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.412506:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb983b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea31253a47cb9842 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969152.412527:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099136256:0@lo:103: 00000100:00100000:1.0:1783969152.412558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969152.412591:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969152.412592:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969152.412594:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969152.412661:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099136128 00000100:00100000:3.0:1783969152.412667:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099136128 00000100:00100000:3.0:1783969152.412712:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783969152.412721:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136128:12345-0@lo:501: 00000100:00100000:3.0:1783969152.412976:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136128:12345-0@lo:501: Request processed in 255us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.412984:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783969152.413138:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136128:0@lo:501: 00000100:00100000:2.0:1783969152.413167:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136384:0@lo:503: 00000100:00100000:2.0:1783969152.413208:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.413235:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1783969152.413858:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969152.413942:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099136384 00000100:00100000:1.0:1783969152.413948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099136384 00000100:00100000:1.0:1783969152.413986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783969152.413993:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136384:12345-0@lo:503: 00000100:00100000:1.0:1783969152.414103:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136384:12345-0@lo:503: Request processed in 110us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.414111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783969152.414337:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136384:0@lo:503: 00000040:00080000:3.0:1783969152.414623:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969152.414858:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136512:0@lo:502: 00000100:00100000:3.0:1783969152.414908:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.414941:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969152.415009:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099136512 00000100:00100000:1.0:1783969152.415014:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099136512 00000100:00100000:1.0:1783969152.415055:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783969152.415063:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136512:12345-0@lo:502: 00000100:00100000:1.0:1783969152.415149:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136512:12345-0@lo:502: Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.415156:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783969152.415438:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136512:0@lo:502: 00000040:00080000:3.0:1783969152.415650:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783969152.415677:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783969152.415879:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783969152.415895:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783969152.415909:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783969152.415922:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783969152.415946:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136640:0@lo:502: 00000100:00100000:3.0:1783969152.415989:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.416063:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969152.416254:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099136256 00000100:00100000:0.0:1783969152.416260:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099136256 00000100:00100000:0.0:1783969152.416318:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969152.416326:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3648:x1870627099136256:12345-0@lo:103: 00010000:00010000:0.0:1783969152.416339:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969152.416359:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdf600/0xea31253a47cb9842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb983b expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.416376:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969152.416437:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:3648:x1870627099136256:12345-0@lo:103: Request processed in 111us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969152.416445:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969152.416473:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099136256:0@lo:103: 00000100:00100000:1.0:1783969152.416823:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099136640 00000100:00100000:1.0:1783969152.416836:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099136640 00000100:00100000:1.0:1783969152.416900:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783969152.416908:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:8430:x1870627099136640:12345-0@lo:502: 00000100:00100000:1.0:1783969152.417005:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:8430:x1870627099136640:12345-0@lo:502: Request processed in 98us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.417011:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783969152.417083:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136640:0@lo:502: 00000040:00080000:0.0:1783969152.417153:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783969152.417164:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1783969152.417857:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783969152.417866:0:8455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1783969152.417873:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969152.417875:0:8455:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783969152.417880:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969152.417894:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93eab612cd40) 00000020:00000080:0.0:1783969152.417915:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783969152.417921:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783969152.417991:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93eab70d7000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783969152.417999:0:8455:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783969152.418005:0:8455:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xea31253a47cb985e 00010000:00010000:0.0:1783969152.423915:0:8455:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1783969152.424679:0:8455:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1783969152.428819:0:8455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1783969152.429585:0:8455:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1783969152.436161:0:8455:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1783969152.436604:0:8455:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1783969152.442643:0:8455:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1783969152.444519:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783969152.444532:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969152.444538:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969152.444540:0:8455:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783969152.444544:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969152.444547:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969152.444549:0:8455:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783969152.444551:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783969152.444553:0:8455:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783969152.444576:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969152.444580:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969152.444581:0:8455:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783969152.444584:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783969152.444911:0:8430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1783969152.444941:0:8430:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783969152.444964:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.444976:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969152.444984:0:8430:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab70d7000 from 1 10000000:01000000:3.0:1783969152.444987:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969152.445020:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.445029:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.445052:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969152.445075:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136768:0@lo:101: 00000100:00100000:3.0:1783969152.445151:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.445191:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969152.445475:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099136768 00000100:00100000:2.0:1783969152.445483:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099136768 00000100:00100000:2.0:1783969152.445523:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783969152.445532:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:8430:x1870627099136768:12345-0@lo:101: 00010000:00010000:2.0:1783969152.445554:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969152.445568:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9865 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.445592:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9865 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.445603:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9865 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.445610:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad8a00, rc 0) 00000100:00100000:2.0:1783969152.445649:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136768:12345-0@lo:101: Request processed in 117us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.445655:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783969152.445839:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136768:0@lo:101: 00010000:00010000:3.0:1783969152.445853:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.445861:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969152.445954:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136896:0@lo:501: 00000100:00100000:3.0:1783969152.445979:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.446008:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969152.446068:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099136896 00000100:00100000:1.0:1783969152.446072:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099136896 00000100:00100000:1.0:1783969152.446103:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783969152.446110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136896:12345-0@lo:501: 00000100:00100000:1.0:1783969152.446219:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099136896:12345-0@lo:501: Request processed in 109us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.446225:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783969152.446468:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099136896:0@lo:501: 00000100:00100000:3.0:1783969152.446491:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137024:0@lo:503: 00000100:00100000:3.0:1783969152.446526:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.446549:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969152.446590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099137024 00000100:00100000:1.0:1783969152.446594:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099137024 00000100:00100000:1.0:1783969152.446619:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783969152.446626:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099137024:12345-0@lo:503: 00000100:00100000:1.0:1783969152.446704:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099137024:12345-0@lo:503: Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.446710:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783969152.446878:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137024:0@lo:503: 00000040:00080000:3.0:1783969152.447108:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969152.447189:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137152:0@lo:502: 00000100:00100000:3.0:1783969152.447233:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.447245:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969152.447428:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099137152 00000100:00100000:1.0:1783969152.447432:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099137152 00000100:00100000:1.0:1783969152.447455:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783969152.447460:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099137152:12345-0@lo:502: 00000100:00100000:1.0:1783969152.447530:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099137152:12345-0@lo:502: Request processed in 68us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.447537:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783969152.447824:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137152:0@lo:502: 00000040:00080000:3.0:1783969152.448013:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783969152.448051:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783969152.448074:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137280:0@lo:502: 00000100:00100000:3.0:1783969152.448126:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.448158:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969152.448217:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099137280 00000100:00100000:1.0:1783969152.448222:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099137280 00000100:00100000:1.0:1783969152.448254:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783969152.448260:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099137280:12345-0@lo:502: 00000100:00100000:1.0:1783969152.448519:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099137280:12345-0@lo:502: Request processed in 258us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.448526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783969152.448599:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137280:0@lo:502: 00000040:00080000:2.0:1783969152.448642:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783969152.448650:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783969152.449172:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969152.449181:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969152.449183:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783969152.449190:0:8458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93eab70d7000 00000020:00000080:2.0:1783969152.449193:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783969152.449215:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969152.449219:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969152.449221:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783969152.449223:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783969152.449447:0:8430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783969152.449469:0:8430:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969152.449490:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.449500:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969152.449552:0:8430:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783969152.449555:0:8430:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93eab70d7000 10000000:01000000:3.0:1783969152.449558:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93eab70d7000 10000000:01000000:3.0:1783969152.449562:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969152.449568:0:8430:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93eab70d7000 from 1 10000000:01000000:3.0:1783969152.449570:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969152.449607:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.449616:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.449625:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969152.449641:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137408:0@lo:101: 00000100:00100000:3.0:1783969152.449674:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.449875:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f7180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969152.449983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099137408 00000100:00100000:2.0:1783969152.449989:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099137408 00000100:00100000:2.0:1783969152.450016:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783969152.450023:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8430:x1870627099137408:12345-0@lo:101: 00010000:00010000:2.0:1783969152.450041:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969152.450054:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9873 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.450076:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9873 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.450086:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9873 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.450418:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9a00, rc 0) 00000100:00100000:2.0:1783969152.450461:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099137408:12345-0@lo:101: Request processed in 438us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.450466:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783969152.450612:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137408:0@lo:101: 00010000:00010000:3.0:1783969152.450627:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.450636:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969152.450780:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137536:0@lo:501: 00000100:00100000:3.0:1783969152.450811:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.450840:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f7180 going to sleep for 11 seconds 00000100:00100000:1.0:1783969152.450886:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099137536 00000100:00100000:1.0:1783969152.450890:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099137536 00000100:00100000:1.0:1783969152.450922:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783969152.450931:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099137536:12345-0@lo:501: 00000100:00100000:1.0:1783969152.451024:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099137536:12345-0@lo:501: Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.451030:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783969152.451994:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137536:0@lo:501: 00000100:00100000:2.0:1783969152.452235:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137664:0@lo:503: 00000100:00100000:2.0:1783969152.452288:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.452329:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83e3bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969152.452349:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099137664 00000100:00100000:2.0:1783969152.452354:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099137664 00000100:00100000:2.0:1783969152.452404:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783969152.452411:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099137664:12345-0@lo:503: 00000100:00100000:2.0:1783969152.452502:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099137664:12345-0@lo:503: Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.452510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783969152.452559:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137664:0@lo:503: 00000040:00080000:2.0:1783969152.452785:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783969152.452864:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137792:0@lo:502: 00000100:00100000:2.0:1783969152.452897:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.452918:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94488300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969152.453490:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099137792 00000100:00100000:2.0:1783969152.453496:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099137792 00000100:00100000:2.0:1783969152.453524:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783969152.453531:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099137792:12345-0@lo:502: 00000100:00100000:2.0:1783969152.453620:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099137792:12345-0@lo:502: Request processed in 88us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.453627:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783969152.453671:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137792:0@lo:502: 00000040:00080000:2.0:1783969152.455597:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783969152.455634:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783969152.455650:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783969152.455664:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783969152.455678:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783969152.455709:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783969152.455724:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783969152.455737:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783969152.455751:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783969152.455766:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783969152.455781:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783969152.455796:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783969152.455809:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783969152.455822:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783969152.455836:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783969152.455851:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783969152.455866:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783969152.455880:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783969152.455894:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783969152.455918:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783969152.455933:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783969152.455946:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783969152.455962:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783969152.455977:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783969152.455991:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1783969152.456022:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1783969152.456039:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1783969152.456052:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1783969152.456066:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1783969152.456079:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1783969152.456094:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1783969152.456108:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1783969152.459512:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1783969152.459556:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1783969152.459571:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1783969152.459584:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1783969152.459596:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1783969152.459642:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137920:0@lo:502: 00000100:00100000:2.0:1783969152.459734:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969152.459780:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83e3bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969152.459812:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099137920 00000100:00100000:2.0:1783969152.459819:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099137920 00000100:00100000:2.0:1783969152.459863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783969152.459871:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099137920:12345-0@lo:502: 00000100:00100000:2.0:1783969152.459979:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099137920:12345-0@lo:502: Request processed in 107us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.459987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783969152.461632:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099137920:0@lo:502: 00000040:00080000:2.0:1783969152.461971:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1783969152.462655:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783969152.465151:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783969152.465180:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93e982194d40) 00000020:00000080:2.0:1783969152.465411:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1783969152.465580:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93eab70d7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783969152.465584:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93eab70d7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783969152.465587:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eab70d7000 3 00010000:00080000:2.0:1783969152.465620:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93e9821a0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1783969152.475804:0:8460:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1783969152.475920:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783969152.475965:0:8460:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783969152.475980:0:8460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xea31253a47cb9888 00000100:00080000:2.0:1783969152.476308:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783969152.476776:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93e9821a0000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969152.476813:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea8e967800 x1870627099138048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969152.476877:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1870627099138048:0@lo:38: 00000100:00100000:0.0:1783969152.476944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783969152.477463:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783969152.477601:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099138176:0@lo:400: 00000100:00100000:3.0:1783969152.477635:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.477657:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969152.477664:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099138560:0@lo:400: 00000100:00100000:3.0:1783969152.477699:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.477730:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099138304:0@lo:400: 00000100:00100000:3.0:1783969152.477749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.477763:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969152.477767:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099138432:0@lo:400: 00000100:00100000:3.0:1783969152.477786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.477811:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099138048 00000100:00100000:3.0:1783969152.477817:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099138048 00000100:00100000:3.0:1783969152.477840:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099138176 00000100:00100000:3.0:1783969152.477842:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099138176 00000100:00100000:3.0:1783969152.477862:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099138432 00000100:00100000:3.0:1783969152.477865:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099138432 00000100:00100000:3.0:1783969152.477879:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969152.477886:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099138176:12345-0@lo:400: 00000100:00100000:3.0:1783969152.477934:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099138176:12345-0@lo:400: Request processed in 48us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.477941:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969152.477954:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969152.477959:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099138432:12345-0@lo:400: 00000100:00100000:3.0:1783969152.477995:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099138432:12345-0@lo:400: Request processed in 25us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.478001:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969152.478011:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969152.478022:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870627099138048:12345-0@lo:38: 00010000:00080000:3.0:1783969152.478103:0:7749:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1783969152.478154:0:7749:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xea31253a47cb988f 00000004:00100000:3.0:1783969152.478169:0:7749:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783969152.478199:0:7749:0:(import.c:65:import_set_state_nolock()) ffff93e981ac4000 : changing import state from RECOVER to FULL 00000020:01000004:2.0:1783969152.478779:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783969152.478792:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93e982190000) 00000020:00000080:2.0:1783969152.478807:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1783969152.478950:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93eab70d7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783969152.478953:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93eab70d7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783969152.478956:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eab70d7000 3 00010000:00080000:2.0:1783969152.478978:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93e9821a1800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1783969152.482823:0:8460:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1783969152.482943:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1783969152.482983:0:8460:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000100:00100000:3.0:1783969152.483217:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870627099138048:12345-0@lo:38: Request processed in 5181us (6260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.483231:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969152.483270:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099138560 00000100:00100000:3.0:1783969152.483278:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099138560 00000100:00100000:3.0:1783969152.483304:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099138304 00000100:00100000:3.0:1783969152.483307:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099138304 00000100:00100000:3.0:1783969152.483330:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969152.483338:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099138560:12345-0@lo:400: 00000100:00100000:3.0:1783969152.483419:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099138560:12345-0@lo:400: Request processed in 82us (5719us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.483426:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969152.483436:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969152.483442:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099138304:12345-0@lo:400: 00000100:00100000:3.0:1783969152.483466:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099138304:12345-0@lo:400: Request processed in 25us (5716us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.483472:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1783969152.483518:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ea8896b100 x1870627099138432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969152.483533:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099138432:0@lo:400: 00000100:00100000:3.0:1783969152.483544:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099138304:0@lo:400: 00000100:00100000:3.0:1783969152.483590:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099138560:0@lo:400: 00010000:00080000:3.0:1783969152.483602:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ea88968000 x1870627099138176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969152.483611:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099138176:0@lo:400: 00000020:00000080:2.0:1783969152.484054:0:8460:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xea31253a47cb989d 00000100:00080000:2.0:1783969152.484062:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783969152.484074:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93e9821a1800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969152.484100:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea8e964380 x1870627099138688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969152.484113:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1783969152.484918:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:0.0:1783969152.485559:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ea8e967800 x1870627099138048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969152.485570:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969152.485580:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1783969152.485588:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783969152.485592:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783969152.485595:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e9821a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783969152.485602:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1870627099138048:0@lo:38: 00000100:00100000:0.0:1783969152.485625:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1870627099138688:0@lo:38: 00000100:00100000:0.0:1783969152.485762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783969152.486896:0:8430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1783969152.486931:0:8430:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783969152.486957:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969152.486969:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783969152.487570:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783969152.487573:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783969152.487574:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969152.487575:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969152.487576:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969152.487578:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969152.487579:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969152.487581:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969152.487582:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969152.487584:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969152.487585:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783969152.487589:0:8430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1783969152.487592:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783969152.487593:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783969152.487594:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969152.487595:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969152.487597:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969152.487598:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969152.487599:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969152.487600:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969152.487601:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969152.487602:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969152.487603:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783969152.487627:0:8430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783969152.487642:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7211880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099138816:0@lo:253: 00000100:00100000:0.0:1783969152.487838:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969152.487982:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969152.488165:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099138688 00000100:00100000:2.0:1783969152.488172:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099138688 00000100:00100000:2.0:1783969152.488227:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969152.488235:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1870627099138688:12345-0@lo:38: 00010000:00080000:2.0:1783969152.488260:0:6522:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1783969152.488292:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xea31253a47cb98a4 00000004:00100000:2.0:1783969152.488307:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783969152.488722:0:6522:0:(import.c:65:import_set_state_nolock()) ffff93e9821a0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969152.488791:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870627099138688:12345-0@lo:38: Request processed in 555us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.488799:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783969152.488998:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ea8e964380 x1870627099138688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969152.489009:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969152.489016:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1783969152.489023:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783969152.489028:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783969152.489031:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e9821a1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783969152.489047:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1870627099138688:0@lo:38: 00000100:00100000:3.0:1783969152.489482:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099138816 00000100:00100000:3.0:1783969152.489488:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099138816 00000100:00100000:0.0:1783969152.489620:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783969152.489629:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099138816:12345-0@lo:253: 20000000:01000000:0.0:1783969152.489654:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783969152.489668:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783969152.500948:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783969152.500962:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783969152.500982:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783969152.501052:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783969152.501074:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.501094:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb97a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb979a expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.501102:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea80031e00/0xea31253a47cb97bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb97b6 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.501110:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.501175:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea80031e00/0xea31253a47cb97bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb97b6 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.501257:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea80031e00/0xea31253a47cb97bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb97b6 expref: 16 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969152.501278:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099138944:0@lo:104: 00000100:00100000:2.0:1783969152.501351:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969152.501427:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb97a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb979a expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.501435:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb97a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb979a expref: 16 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969152.501444:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e966300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099139072:0@lo:104: 00000100:00100000:2.0:1783969152.501464:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969152.501554:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783969152.501621:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969152.501643:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099138944 00000100:00100000:1.0:1783969152.501650:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099138944 00000100:00100000:1.0:1783969152.501734:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099139072 00000100:00100000:1.0:1783969152.501738:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099139072 00000100:00100000:2.0:1783969152.501893:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:8430:x1870627099138816:12345-0@lo:253: Request processed in 12264us (14054us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969152.501903:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783969152.503311:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969152.503327:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab92bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6537:x1870627099138944:12345-0@lo:104: 00010000:00010000:1.0:1783969152.503341:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb97b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969152.503425:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969152.503431:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab92bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6537:x1870627099138944:12345-0@lo:104: Request processed in 112us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.503438:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969152.503485:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783969152.503491:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6537:x1870627099139072:12345-0@lo:104: 00010000:00010000:1.0:1783969152.503499:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb979a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969152.503712:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7211880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:8430:1870627099138816:0@lo:253: 10000000:01000000:0.0:1783969152.503724:0:8430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783969152.503727:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783969152.503729:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783969152.503731:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969152.503732:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969152.503733:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969152.503734:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969152.503735:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969152.503736:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969152.503738:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969152.503740:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969152.503741:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783969152.503754:0:8430:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1783969152.504082:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099138944:0@lo:104: 00010000:00010000:1.0:1783969152.504327:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783969152.504334:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6537:x1870627099139072:12345-0@lo:104: Request processed in 842us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969152.504340:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783969152.504444:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e966300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099139072:0@lo:104: 00010000:00010000:2.0:1783969152.504461:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.509962:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969152.509976:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb97b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.509987:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601800 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969152.509991:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb97b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.510002:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb97b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969152.510009:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb97b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969152.510015:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00080000:10000000:0.0:1783969152.511550:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1783969152.511739:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1783969152.511923:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00010000:00010000:3.0:1783969152.512408:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb97b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.512418:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969152.512435:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb97b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.512443:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb97b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97bd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969152.512474:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099139200:0@lo:103: 00000100:00100000:3.0:1783969152.512528:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.512587:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099139200 00000100:00100000:3.0:1783969152.512594:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099139200 00010000:00010000:3.0:1783969152.512618:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea80031e00/0xea31253a47cb97bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb97b6 expref: 16 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969152.512648:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969152.512657:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3649:x1870627099139200:12345-0@lo:103: 00010000:00010000:3.0:1783969152.512670:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969152.512674:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea80031e00/0xea31253a47cb97bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb97b6 expref: 16 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.512685:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea80031e00/0xea31253a47cb97bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb97b6 expref: 16 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.512700:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea80031e00/0xea31253a47cb97bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb97b6 expref: 16 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.512714:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969152.512748:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3649:x1870627099139200:12345-0@lo:103: Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.512753:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969152.512789:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099139200:0@lo:103: 00010000:00010000:3.0:1783969152.512807:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969152.512812:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb979a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.512829:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176a00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969152.512832:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb979a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.512839:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb979a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969152.512846:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb979a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969152.512851:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969152.512876:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb979a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.512882:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969152.512905:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb979a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.512912:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb979a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb97a1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969152.512931:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099139328:0@lo:103: 00000100:00100000:3.0:1783969152.512953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969152.512978:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099139328 00000100:00100000:3.0:1783969152.512982:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099139328 00010000:00010000:3.0:1783969152.512993:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb97a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb979a expref: 15 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969152.513013:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969152.513026:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3646:x1870627099139328:12345-0@lo:103: 00010000:00010000:3.0:1783969152.513049:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969152.513053:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb97a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb979a expref: 15 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513062:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb97a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb979a expref: 15 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513071:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb97a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb979a expref: 15 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513082:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513090:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783969152.513102:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012051864s 00010000:00010000:3.0:1783969152.513106:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513112:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513131:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513138:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513143:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969152.513151:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513159:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513171:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969152.513180:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969152.513204:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:3646:x1870627099139328:12345-0@lo:103: Request processed in 179us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969152.513210:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969152.513232:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099139328:0@lo:103: 00010000:00010000:3.0:1783969152.513243:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969152.513245:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969152.513247:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1783969152.513964:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1783969152.514535:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1783969152.516897:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:1.0:1783969152.518028:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783969152.519349:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1783969152.520169:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.520773:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969152.520792:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad8600/0xea31253a47cb98ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783969152.533643:0:8430:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783969152.533652:0:8430:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783969152.533687:0:8430:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783969152.533737:0:8430:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783969152.534083:0:8430:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783969152.534107:0:8430:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1783969152.534943:0:8430:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969152.535159:0:8430:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783969152.819069:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969153.853833:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783969153.965176:0:8515:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969153.965604:0:8515:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783969154.866711:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969154.929551:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969154.929578:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099139456:0@lo:41: 00000100:00100000:0.0:1783969154.929650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969154.929838:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099139456 00000100:00100000:1.0:1783969154.929846:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099139456 00000100:00100000:1.0:1783969154.929898:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783969154.929909:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099139456:12345-0@lo:41: 00000004:00000024:1.0:1783969154.929944:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1783969154.929999:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099139456:12345-0@lo:41: Request processed in 91us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969154.930006:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969154.930104:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099139456:0@lo:41: 00000100:00100000:0.0:1783969155.442110:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099139584:0@lo:41: 00000100:00100000:0.0:1783969155.442207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969155.442309:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099139584 00000100:00100000:1.0:1783969155.442318:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099139584 00000100:00100000:1.0:1783969155.442371:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783969155.442420:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099139584:12345-0@lo:41: 00000004:00000024:1.0:1783969155.442458:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1783969155.442500:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099139584:12345-0@lo:41: Request processed in 82us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969155.442507:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783969155.457606:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099139584:0@lo:41: 00010000:00010000:2.0:1783969155.896545:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969156.914629:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969157.490753:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099139712:0@lo:400: 00000100:00100000:1.0:1783969157.490858:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969157.490919:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099140224:0@lo:400: 00000100:00100000:1.0:1783969157.490951:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969157.490983:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969157.490989:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099140096:0@lo:400: 00000100:00100000:1.0:1783969157.491018:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969157.491058:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099139840:0@lo:400: 00000100:00100000:1.0:1783969157.491086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969157.491102:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099140352:0@lo:400: 00000100:00100000:1.0:1783969157.491130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969157.491150:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783969157.491155:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099139968:0@lo:400: 00000100:00100000:1.0:1783969157.491182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969157.491197:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099140480:0@lo:400: 00000100:00100000:1.0:1783969157.491220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969157.491249:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099140224 00000100:00100000:1.0:1783969157.491258:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099140224 00000100:00100000:1.0:1783969157.491303:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099139968 00000100:00100000:1.0:1783969157.491306:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099139968 00000100:00100000:1.0:1783969157.491342:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969157.491351:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099140224:12345-0@lo:400: 00000100:00100000:1.0:1783969157.491471:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099140224:12345-0@lo:400: Request processed in 120us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969157.491480:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969157.491498:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783969157.491505:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099139968:12345-0@lo:400: 00000100:00100000:1.0:1783969157.491539:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099139968:12345-0@lo:400: Request processed in 34us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969157.491545:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783969157.491564:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099140096 00000100:00100000:1.0:1783969157.491568:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099140096 00000100:00100000:1.0:1783969157.491587:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099139840 00000100:00100000:1.0:1783969157.491590:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099139840 00000100:00100000:1.0:1783969157.491599:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099140352 00000100:00100000:1.0:1783969157.491602:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099140352 00000100:00100000:1.0:1783969157.491626:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099140480 00000100:00100000:1.0:1783969157.491628:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099140480 00000100:00100000:1.0:1783969157.491644:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783969157.491650:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099140096:12345-0@lo:400: 00000100:00100000:1.0:1783969157.491679:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099140096:12345-0@lo:400: Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969157.491685:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783969157.491696:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783969157.491701:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099139840:12345-0@lo:400: 00000100:00100000:1.0:1783969157.491726:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099139840:12345-0@lo:400: Request processed in 25us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969157.491732:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783969157.491752:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783969157.491758:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099140352:12345-0@lo:400: 00000100:00100000:1.0:1783969157.491786:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099140352:12345-0@lo:400: Request processed in 29us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969157.491792:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783969157.491802:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783969157.491807:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099140480:12345-0@lo:400: 00000100:00100000:1.0:1783969157.491831:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099140480:12345-0@lo:400: Request processed in 24us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969157.491836:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783969157.491877:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099139968:0@lo:400: 00010000:00080000:1.0:1783969157.491893:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981ac8000 x1870627099140480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969157.491904:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099140480:0@lo:400: 00010000:00080000:1.0:1783969157.491914:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981ac9500 x1870627099139840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969157.491921:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099139840:0@lo:400: 00010000:00080000:1.0:1783969157.491929:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981ac9180 x1870627099140352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969157.491937:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099140352:0@lo:400: 00010000:00080000:1.0:1783969157.491974:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981ac8e00 x1870627099140096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969157.491982:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099140096:0@lo:400: 00000100:00100000:1.0:1783969157.491994:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099140224:0@lo:400: 00000100:00100000:2.0:1783969157.492492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099139712 00000100:00100000:2.0:1783969157.492500:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099139712 00000100:00100000:2.0:1783969157.492557:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783969157.492567:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:3649:x1870627099139712:12345-0@lo:400: 00000100:00100000:2.0:1783969157.492629:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:3649:x1870627099139712:12345-0@lo:400: Request processed in 64us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969157.492636:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1783969157.492685:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969157.492690:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969157.499048:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099139712:0@lo:400: 00010000:00010000:1.0:1783969157.947026:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969158.960514:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969159.989958:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969160.049693:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969160.049723:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099140608:0@lo:41: 00000100:00100000:0.0:1783969160.049801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969160.049870:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099140608 00000100:00100000:0.0:1783969160.049878:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099140608 00000100:00100000:0.0:1783969160.049928:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969160.049937:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099140608:12345-0@lo:41: 00000004:00000024:0.0:1783969160.049974:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1783969160.050034:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099140608:12345-0@lo:41: Request processed in 97us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969160.050042:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969160.050099:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099140608:0@lo:41: 00000001:02000400:0.0:1783969160.443361:0:8805:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783969160.561606:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969160.561636:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099140736:0@lo:41: 00000100:00100000:3.0:1783969160.561713:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969160.561920:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099140736 00000100:00100000:0.0:1783969160.561928:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099140736 00000100:00100000:0.0:1783969160.561996:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783969160.562007:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099140736:12345-0@lo:41: 00000004:00000024:0.0:1783969160.562043:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783969160.562108:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099140736:12345-0@lo:41: Request processed in 102us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969160.562116:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783969160.562343:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099140736:0@lo:41: 00010000:00010000:1.0:1783969161.015302:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783969161.076057:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783969161.076077:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93eab929d800 from 30 10000000:01000000:0.0:1783969161.076085:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783969161.076164:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969161.076180:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969161.076193:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969161.076226:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9177800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099140864:0@lo:101: 00000100:00100000:0.0:1783969161.076323:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969161.076439:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b2000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.078588:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099140864 00000100:00100000:2.0:1783969161.078606:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099140864 00000100:00100000:2.0:1783969161.078675:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783969161.078686:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:6518:x1870627099140864:12345-0@lo:101: 00010000:00010000:2.0:1783969161.078704:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969161.078722:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb98b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.078752:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb98b2 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.078764:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb98b2 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.078792:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9400, rc 0) 00000100:00100000:2.0:1783969161.078887:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099140864:12345-0@lo:101: Request processed in 203us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.078894:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783969161.079029:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9177800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099140864:0@lo:101: 00010000:00010000:1.0:1783969161.079048:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.079058:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969161.079135:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099140992:0@lo:501: 00000100:00100000:1.0:1783969161.079171:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.079211:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea865d9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.079265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099140992 00000100:00100000:2.0:1783969161.079270:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099140992 00000100:00100000:2.0:1783969161.079302:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783969161.079309:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099140992:12345-0@lo:501: 00000100:00100000:2.0:1783969161.079467:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099140992:12345-0@lo:501: Request processed in 158us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.079474:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783969161.079624:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099140992:0@lo:501: 00000100:00100000:1.0:1783969161.079660:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141120:0@lo:503: 00000100:00100000:1.0:1783969161.079712:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.079743:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea865d9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.079992:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099141120 00000100:00100000:2.0:1783969161.079998:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099141120 00000100:00100000:2.0:1783969161.080032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783969161.080039:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099141120:12345-0@lo:503: 00000100:00100000:2.0:1783969161.080123:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099141120:12345-0@lo:503: Request processed in 85us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.080129:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783969161.080223:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141120:0@lo:503: 00000100:00100000:1.0:1783969161.080565:0:8829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8829:1870627099141248:0@lo:502: 00000100:00100000:1.0:1783969161.080602:0:8829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.080622:0:8829:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222af00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.080668:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099141248 00000100:00100000:2.0:1783969161.080673:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099141248 00000100:00100000:2.0:1783969161.080706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783969161.080713:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8829:x1870627099141248:12345-0@lo:502: 00000100:00100000:2.0:1783969161.080791:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8829:x1870627099141248:12345-0@lo:502: Request processed in 78us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.080797:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783969161.080883:0:8829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8829:1870627099141248:0@lo:502: 00000100:00100000:1.0:1783969161.080922:0:8829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8829:1870627099141376:0@lo:502: 00000100:00100000:1.0:1783969161.080960:0:8829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.080993:0:8829:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222af00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.081044:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099141376 00000100:00100000:2.0:1783969161.081054:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099141376 00000100:00100000:2.0:1783969161.081186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783969161.081194:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8829:x1870627099141376:12345-0@lo:502: 00000100:00100000:2.0:1783969161.081263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:8829:x1870627099141376:12345-0@lo:502: Request processed in 69us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.081270:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783969161.087227:0:8829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8829:1870627099141376:0@lo:502: 00000040:00080000:1.0:1783969161.087280:0:8829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783969161.087359:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783969161.091487:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969161.091508:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.091522:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969161.091534:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783969161.091538:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93eab929d800 from 5 10000000:01000000:1.0:1783969161.091541:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783969161.091587:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.091595:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.091605:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969161.091630:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141504:0@lo:101: 00000100:00100000:1.0:1783969161.091706:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.091748:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222af00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969161.091790:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099141504 00000100:00100000:1.0:1783969161.091797:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099141504 00000100:00100000:1.0:1783969161.091861:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783969161.091871:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099141504:12345-0@lo:101: 00010000:00010000:1.0:1783969161.091886:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969161.091899:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb98c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.091923:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb98c0 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.091935:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb98c0 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.091945:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b601a00, rc 0) 00000100:00100000:1.0:1783969161.092002:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099141504:12345-0@lo:101: Request processed in 130us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969161.092009:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783969161.092055:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141504:0@lo:101: 00010000:00010000:1.0:1783969161.092072:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.092083:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969161.092160:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141632:0@lo:256: 00000100:00100000:1.0:1783969161.092198:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.092213:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222af00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969161.092240:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099141632 00000100:00100000:1.0:1783969161.092244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099141632 00000100:00100000:1.0:1783969161.092266:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783969161.092283:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099141632:12345-0@lo:256: 20000000:01000000:1.0:1783969161.092299:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783969161.092316:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783969161.092320:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1783969161.092509:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099141632:12345-0@lo:256: Request processed in 227us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969161.092517:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783969161.092543:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141632:0@lo:256: 10000000:01000000:1.0:1783969161.092587:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783969161.092594:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.092602:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969161.092610:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783969161.092613:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1783969161.092616:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783969161.092636:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.092643:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.092651:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969161.092667:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141760:0@lo:101: 00000100:00100000:1.0:1783969161.092706:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.092781:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222af00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969161.092830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099141760 00000100:00100000:1.0:1783969161.092835:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099141760 00000100:00100000:1.0:1783969161.092861:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783969161.092868:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099141760:12345-0@lo:101: 00010000:00010000:1.0:1783969161.092877:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969161.092885:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb98ce expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.092903:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb98ce expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.092912:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb98ce expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.092920:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600e00, rc 0) 00000100:00100000:1.0:1783969161.092959:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099141760:12345-0@lo:101: Request processed in 90us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969161.092965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783969161.093002:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141760:0@lo:101: 00010000:00010000:1.0:1783969161.093012:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969161.093020:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969161.093068:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141888:0@lo:501: 00000100:00100000:1.0:1783969161.093093:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.093101:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222af00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969161.093127:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099141888 00000100:00100000:1.0:1783969161.093134:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099141888 00000100:00100000:1.0:1783969161.093157:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783969161.093166:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099141888:12345-0@lo:501: 00000100:00100000:1.0:1783969161.093295:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099141888:12345-0@lo:501: Request processed in 131us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969161.093301:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783969161.093328:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099141888:0@lo:501: 00000100:00100000:1.0:1783969161.093358:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099142016:0@lo:503: 00000100:00100000:1.0:1783969161.093434:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.093448:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969161.093463:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099142016 00000100:00100000:1.0:1783969161.093466:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099142016 00000100:00100000:1.0:1783969161.093482:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783969161.093490:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099142016:12345-0@lo:503: 00000100:00100000:1.0:1783969161.093579:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099142016:12345-0@lo:503: Request processed in 90us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969161.093585:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783969161.093627:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099142016:0@lo:503: 00000100:00100000:0.0:1783969161.101022:0:8831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8831:1870627099142144:0@lo:502: 00000100:00100000:0.0:1783969161.106772:0:8831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969161.106838:0:8831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969161.107710:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099142144 00000100:00100000:0.0:1783969161.107724:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099142144 00000100:00100000:0.0:1783969161.107797:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783969161.107823:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:8831:x1870627099142144:12345-0@lo:502: 00000100:00100000:0.0:1783969161.108038:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:8831:x1870627099142144:12345-0@lo:502: Request processed in 217us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969161.108058:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783969161.108154:0:8831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8831:1870627099142144:0@lo:502: 00000020:01000000:0.0:1783969161.108200:0:8831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783969161.108208:0:8831:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783969161.108217:0:8831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969161.108220:0:8831:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783969161.108225:0:8831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783969161.108229:0:8831:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:0.0:1783969161.108256:0:8831:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783969161.108259:0:8831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969161.108290:0:8831:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93eab7164d40) 00000020:00000080:0.0:1783969161.108321:0:8831:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783969161.108328:0:8831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783969161.108907:0:8831:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1783969161.108918:0:8831:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783969161.108944:0:8831:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cb98e3 00010000:00080000:0.0:1783969161.109001:0:8831:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eab725e800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969161.109725:0:8831:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783969161.125682:0:8831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783969161.125718:0:8831:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783969161.126619:0:8831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969161.126964:0:8831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969161.127095:0:8831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783969161.127199:0:8831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1783969161.133528:0:8833:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783969161.133536:0:8833:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783969161.144572:0:8831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783969161.144599:0:8831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783969161.144649:0:8831:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783969161.144676:0:8831:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cb98ea 00000100:00080000:2.0:1783969161.144688:0:8831:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783969161.144694:0:8831:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93eab725e800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969161.147493:0:8831:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea8e966300 x1870627099142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969161.147527:0:8831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783969161.147605:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099142272:0@lo:8: 00000100:00100000:1.0:1783969161.147680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.147755:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099142272 00000100:00100000:1.0:1783969161.147762:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099142272 00000100:00100000:1.0:1783969161.147810:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969161.147817:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099142272:12345-0@lo:8: 00010000:00080000:1.0:1783969161.147844:0:8436:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:1.0:1783969161.147880:0:8436:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cb98f1 00002000:00100000:1.0:1783969161.147915:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93eab929f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1783969161.147920:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1783969161.147924:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1783969161.148014:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783969161.148225:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1783969161.148251:0:8436:0:(import.c:65:import_set_state_nolock()) ffff93eab70d0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969161.148315:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1870627099142272:12345-0@lo:8: Request processed in 497us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969161.148323:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783969161.149223:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8e966300 x1870627099142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969161.149256:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783969161.149270:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1783969161.149283:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783969161.149290:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783969161.149294:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab725e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783969161.149319:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783969161.149326:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099142272:0@lo:8: 00000004:00080000:1.0:1783969161.149547:0:8833:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783969161.149698:0:8833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 223277316350ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783969161.149705:0:8833:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:2.0:1783969161.158528:0:8831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969161.158538:0:8831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969161.158540:0:8831:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783969161.158544:0:8831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969161.158549:0:8831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969161.158550:0:8831:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783969161.158554:0:8831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783969161.158555:0:8831:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783969161.158611:0:8831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8831:1870627099142400:0@lo:502: 00000100:00100000:2.0:1783969161.158716:0:8831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.158760:0:8831:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.159836:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099142400 00000100:00100000:2.0:1783969161.159857:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099142400 00000100:00100000:2.0:1783969161.159903:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783969161.159911:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:8831:x1870627099142400:12345-0@lo:502: 00000100:00100000:2.0:1783969161.160069:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:8831:x1870627099142400:12345-0@lo:502: Request processed in 158us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.160077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783969161.160292:0:8834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8834:1870627099142528:0@lo:700: 00000100:00100000:3.0:1783969161.160366:0:8834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969161.160423:0:8834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969161.163659:0:8831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8831:1870627099142400:0@lo:502: 00000020:01000000:3.0:1783969161.164643:0:8831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969161.164654:0:8831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969161.164657:0:8831:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783969161.164665:0:8831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1783969161.164754:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1783969161.164778:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783969161.164788:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.164800:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969161.164810:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783969161.164813:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93ea912c9800 from 30 10000000:01000000:3.0:1783969161.164816:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969161.164848:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.164866:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.164876:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969161.164897:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099142656:0@lo:101: 00000100:00100000:3.0:1783969161.164960:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969161.165033:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969161.167542:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099142528 00000100:00100000:0.0:1783969161.167556:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099142528 00000100:00100000:0.0:1783969161.167623:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969161.167635:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8834:x1870627099142528:12345-0@lo:700: 00000100:00100000:0.0:1783969161.167763:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8445:1870627099142784:0@lo:700: 00000100:00100000:0.0:1783969161.167826:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969161.167865:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969161.167884:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099142784 00000100:00100000:0.0:1783969161.167888:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099142784 00000100:00100000:0.0:1783969161.167917:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969161.167924:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8445:x1870627099142784:12345-0@lo:700: 00000100:00080000:1.0:1783969161.168145:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969161.168150:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969161.168503:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099142656 00000100:00100000:3.0:1783969161.168510:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099142656 00000100:00100000:3.0:1783969161.168542:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783969161.168550:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099142656:12345-0@lo:101: 00010000:00010000:3.0:1783969161.168566:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969161.168599:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb98f8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.168623:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb98f8 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.168635:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb98f8 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.168644:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796400, rc 0) 00000100:00100000:3.0:1783969161.168704:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099142656:12345-0@lo:101: Request processed in 155us (3744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969161.168710:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783969161.173614:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099142912:0@lo:400: 00000100:00100000:2.0:1783969161.174824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.174904:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099142912 00000100:00100000:2.0:1783969161.174912:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099142912 00000100:00100000:2.0:1783969161.174964:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783969161.174974:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099142912:12345-0@lo:400: 00000100:00100000:2.0:1783969161.175054:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099142912:12345-0@lo:400: Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.175062:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1783969161.175111:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8e965c00 x1870627099142912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.175125:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099142912:0@lo:400: 00000100:00100000:2.0:1783969161.177673:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099143040:0@lo:400: 00000100:00100000:2.0:1783969161.177765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.177826:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099143040 00000100:00100000:2.0:1783969161.177833:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099143040 00000100:00100000:2.0:1783969161.177876:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969161.177884:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099143040:12345-0@lo:400: 00000100:00100000:2.0:1783969161.177935:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099143040:12345-0@lo:400: Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.177957:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969161.178010:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099143040:0@lo:400: 00000100:00100000:2.0:1783969161.178047:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099143168:0@lo:400: 00000100:00100000:2.0:1783969161.178081:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.178117:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099143168 00000100:00100000:2.0:1783969161.178121:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099143168 00000100:00100000:2.0:1783969161.178155:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783969161.178161:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099143168:12345-0@lo:400: 00000100:00100000:2.0:1783969161.178193:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099143168:12345-0@lo:400: Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.178200:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1783969161.178227:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8e965c00 x1870627099143168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.178238:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099143168:0@lo:400: 00000100:00100000:2.0:1783969161.178281:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969161.178288:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099143296:0@lo:400: 00000100:00100000:2.0:1783969161.178311:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.178331:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099143296 00000100:00100000:2.0:1783969161.178334:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099143296 00000100:00100000:2.0:1783969161.178356:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783969161.178361:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099143296:12345-0@lo:400: 00000100:00100000:2.0:1783969161.178417:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099143296:12345-0@lo:400: Request processed in 55us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.178423:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783969161.178446:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099143296:0@lo:400: 00000100:00100000:2.0:1783969161.178482:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099143424:0@lo:400: 00000100:00100000:2.0:1783969161.178509:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.178534:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099143424 00000100:00100000:2.0:1783969161.178537:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099143424 00000100:00100000:2.0:1783969161.178568:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783969161.178574:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099143424:12345-0@lo:400: 00000100:00100000:2.0:1783969161.178605:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099143424:12345-0@lo:400: Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.178611:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1783969161.178626:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783969161.178644:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8e965c00 x1870627099143424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.178653:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099143424:0@lo:400: 00000100:00100000:0.0:1783969161.182481:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099142656:0@lo:101: 00010000:00010000:0.0:1783969161.182510:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969161.182523:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969161.182618:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099143552:0@lo:501: 00000100:00100000:0.0:1783969161.182697:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969161.182745:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b2840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.183151:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099143552 00000100:00100000:2.0:1783969161.183160:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099143552 00000100:00100000:2.0:1783969161.183220:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783969161.183275:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099143552:12345-0@lo:501: 00000100:00100000:2.0:1783969161.183431:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099143552:12345-0@lo:501: Request processed in 202us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.183440:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783969161.183607:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099143552:0@lo:501: 00000100:00100000:0.0:1783969161.183642:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099143680:0@lo:503: 00000100:00100000:0.0:1783969161.183693:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969161.183713:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b2840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969161.183727:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099143680 00000100:00100000:0.0:1783969161.183731:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099143680 00000100:00100000:0.0:1783969161.183754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783969161.183761:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099143680:12345-0@lo:503: 00000100:00100000:0.0:1783969161.183841:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099143680:12345-0@lo:503: Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969161.183847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783969161.183888:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099143680:0@lo:503: 00000004:00080000:1.0:1783969161.185651:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1783969161.188907:0:8836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8836:1870627099143808:0@lo:502: 00000100:00100000:1.0:1783969161.188998:0:8836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.189045:0:8836:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.189153:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099143808 00000100:00100000:2.0:1783969161.189161:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099143808 00000100:00100000:2.0:1783969161.189208:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783969161.189217:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:8836:x1870627099143808:12345-0@lo:502: 00000100:00100000:2.0:1783969161.189408:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:8836:x1870627099143808:12345-0@lo:502: Request processed in 191us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.189436:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 40000000:02000000:0.0:1783969161.192819:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1783969161.197654:0:8836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8836:1870627099143808:0@lo:502: 00000100:00100000:1.0:1783969161.197739:0:8836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8836:1870627099143936:0@lo:502: 00000100:00100000:1.0:1783969161.197812:0:8836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969161.197859:0:8836:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.197927:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099143936 00000100:00100000:2.0:1783969161.197935:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099143936 00000100:00100000:2.0:1783969161.197999:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783969161.198008:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:8836:x1870627099143936:12345-0@lo:502: 00000100:00100000:2.0:1783969161.198125:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:8836:x1870627099143936:12345-0@lo:502: Request processed in 118us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.198133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783969161.198241:0:8836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8836:1870627099143936:0@lo:502: 00000040:00080000:1.0:1783969161.198261:0:8836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783969161.198423:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783969161.198445:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783969161.198455:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.198466:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969161.198474:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783969161.198477:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93ea912c9800 from 5 10000000:01000000:2.0:1783969161.198480:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783969161.198504:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.198512:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.198521:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969161.198534:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144064:0@lo:101: 00000100:00100000:2.0:1783969161.198570:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.198589:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969161.198701:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099144064 00000100:00100000:3.0:1783969161.198711:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099144064 00000100:00100000:3.0:1783969161.198746:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783969161.198753:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099144064:12345-0@lo:101: 00010000:00010000:3.0:1783969161.198762:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969161.198775:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9906 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.198797:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9906 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.198806:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9906 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.198813:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796c00, rc 0) 00000100:00100000:3.0:1783969161.198845:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099144064:12345-0@lo:101: Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969161.198850:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783969161.200652:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144064:0@lo:101: 00010000:00010000:2.0:1783969161.200677:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.200690:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969161.200756:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144192:0@lo:256: 00000100:00100000:2.0:1783969161.200820:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.200863:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969161.200908:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099144192 00000100:00100000:3.0:1783969161.200915:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099144192 00000100:00100000:3.0:1783969161.200962:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783969161.200971:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099144192:12345-0@lo:256: 20000000:01000000:3.0:1783969161.201002:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783969161.201020:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783969161.201023:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783969161.201113:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099144192:12345-0@lo:256: Request processed in 142us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969161.201121:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783969161.201192:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144192:0@lo:256: 10000000:01000000:2.0:1783969161.201235:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783969161.201243:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.201251:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969161.201260:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783969161.201263:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1783969161.201265:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783969161.201287:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.201296:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.201315:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969161.201327:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144320:0@lo:101: 00000100:00100000:2.0:1783969161.201354:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.201375:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969161.201507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099144320 00000100:00100000:3.0:1783969161.201512:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099144320 00000100:00100000:3.0:1783969161.201544:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783969161.201550:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099144320:12345-0@lo:101: 00010000:00010000:3.0:1783969161.201559:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969161.201571:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9914 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.201589:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9914 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.201598:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9914 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.201607:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796000, rc 0) 00000100:00100000:3.0:1783969161.201634:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099144320:12345-0@lo:101: Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969161.201639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783969161.201695:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144320:0@lo:101: 00010000:00010000:2.0:1783969161.201705:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.201713:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969161.201762:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144448:0@lo:501: 00000100:00100000:2.0:1783969161.201786:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.201809:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.201821:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099144448 00000100:00100000:2.0:1783969161.201825:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099144448 00000100:00100000:2.0:1783969161.201845:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783969161.201851:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099144448:12345-0@lo:501: 00000100:00100000:2.0:1783969161.201954:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099144448:12345-0@lo:501: Request processed in 102us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.201960:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783969161.202001:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144448:0@lo:501: 00000100:00100000:2.0:1783969161.202024:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144576:0@lo:503: 00000100:00100000:2.0:1783969161.202072:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.202086:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.202097:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099144576 00000100:00100000:2.0:1783969161.202100:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099144576 00000100:00100000:2.0:1783969161.202117:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783969161.202122:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099144576:12345-0@lo:503: 00000100:00100000:2.0:1783969161.202196:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099144576:12345-0@lo:503: Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.202202:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783969161.202239:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e965c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099144576:0@lo:503: 00000100:00100000:0.0:1783969161.205004:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8445:x1870627099142784:12345-0@lo:700: Request processed in 37072us (37169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969161.205018:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783969161.205197:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab9176680 x1870627099142784/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.205213:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8445:1870627099142784:0@lo:700: 40000000:02000000:2.0:1783969161.205226:0:8445:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1783969161.207696:0:8837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8837:1870627099144704:0@lo:502: 00000100:00100000:0.0:1783969161.207789:0:8837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969161.207828:0:8837:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b2840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969161.210554:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099144704 00000100:00100000:3.0:1783969161.210569:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099144704 00000100:00100000:3.0:1783969161.210634:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783969161.210644:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:8837:x1870627099144704:12345-0@lo:502: 00000100:00100000:3.0:1783969161.210819:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:8837:x1870627099144704:12345-0@lo:502: Request processed in 175us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969161.210828:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783969161.212207:0:8837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8837:1870627099144704:0@lo:502: 00000020:01000000:0.0:1783969161.212242:0:8837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783969161.212249:0:8837:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783969161.212257:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969161.212260:0:8837:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783969161.212265:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783969161.212268:0:8837:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:0.0:1783969161.212294:0:8837:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783969161.212296:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969161.212312:0:8837:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93eab7160000) 00000020:00000080:0.0:1783969161.212334:0:8837:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1783969161.212340:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783969161.212609:0:8837:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783969161.212615:0:8837:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783969161.212623:0:8837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cb9929 00010000:00080000:0.0:1783969161.212662:0:8837:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eab7259800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969161.212886:0:8837:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1783969161.216187:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783969161.216352:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8834:x1870627099142528:12345-0@lo:700: Request processed in 48715us (55981us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.216370:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783969161.216607:0:8834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8896b100 x1870627099142528/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969161.216638:0:8834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8834:1870627099142528:0@lo:700: 00000040:01000000:3.0:1783969161.225255:0:8837:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783969161.225279:0:8837:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783969161.225680:0:8837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969161.225894:0:8837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969161.225998:0:8837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783969161.227249:0:8837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1783969161.227792:0:8838:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969161.227797:0:8838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000004:00080000:3.0:1783969161.229951:0:8834:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783969161.229991:0:8834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8834:1870627099144960:0@lo:7: 00000100:00100000:3.0:1783969161.230051:0:8834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969161.230096:0:8834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83e3bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.230194:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099144832:0@lo:13: 00000100:00100000:2.0:1783969161.230245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969161.230335:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099144832 00000100:00100000:3.0:1783969161.230343:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099144832 00000100:00100000:3.0:1783969161.230421:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969161.230429:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099144832:12345-0@lo:13: 00002000:00000024:3.0:1783969161.230454:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1783969161.230491:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099144832:12345-0@lo:13: Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969161.230497:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969161.230677:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099144960 00000100:00100000:0.0:1783969161.230682:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099144960 00000100:00100000:0.0:1783969161.230731:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969161.230738:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8834:x1870627099144960:12345-0@lo:7: 00010000:00080000:2.0:1783969161.231535:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8896b100 x1870627099144832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.231556:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099144832:0@lo:13: 00002000:00080000:0.0:1783969161.239043:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783969161.239052:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783969161.239512:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8834:x1870627099144960:12345-0@lo:7: Request processed in 8770us (9456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969161.239524:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783969161.240094:0:8834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8896b800 x1870627099144960/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969161.240112:0:8834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8834:1870627099144960:0@lo:7: 00000004:00080000:3.0:1783969161.240126:0:8834:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783969161.240163:0:8834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8834:1870627099145088:0@lo:5: 00000100:00100000:3.0:1783969161.240200:0:8834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969161.240232:0:8834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83e3bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.240366:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099145088 00000100:00100000:2.0:1783969161.240373:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099145088 00000020:00000080:0.0:1783969161.240781:0:8837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783969161.240795:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783969161.240838:0:8837:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783969161.240861:0:8837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cb9930 00000100:00080000:0.0:1783969161.240869:0:8837:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969161.240873:0:8837:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93eab7259800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969161.240897:0:8837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eab9175c00 x1870627099145216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783969161.240925:0:8837:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783969161.240997:0:8837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969161.241002:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969161.241004:0:8837:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783969161.241007:0:8837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969161.241011:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969161.241012:0:8837:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783969161.241015:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969161.241017:0:8837:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783969161.241038:0:8837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8837:1870627099145344:0@lo:502: 00000100:00100000:3.0:1783969161.241159:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099145216:0@lo:8: 00000100:00100000:3.0:1783969161.241199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969161.241247:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099145216 00000100:00100000:3.0:1783969161.241251:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099145216 00000100:00100000:3.0:1783969161.241287:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969161.241308:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099145216:12345-0@lo:8: 00010000:00080000:3.0:1783969161.241341:0:8436:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1783969161.241367:0:8436:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cb9937 00002000:00100000:3.0:1783969161.241404:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93e981ac7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783969161.241420:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783969161.241423:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783969161.241492:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783969161.241514:0:8436:0:(import.c:65:import_set_state_nolock()) ffff93e981ac1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969161.241560:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1870627099145216:12345-0@lo:8: Request processed in 265us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969161.241568:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783969161.241598:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab9175c00 x1870627099145216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969161.241608:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783969161.241615:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783969161.241621:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783969161.241625:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783969161.241627:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab7259800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783969161.241637:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783969161.241642:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099145216:0@lo:8: 00000004:00080000:3.0:1783969161.241663:0:8838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783969161.241725:0:8838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 223369343712ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783969161.241731:0:8838:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783969161.242762:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969161.242779:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8834:x1870627099145088:12345-0@lo:5: 00002000:00080000:2.0:1783969161.242808:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1783969161.242864:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8834:x1870627099145088:12345-0@lo:5: Request processed in 87us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.242870:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783969161.242927:0:8834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8896b800 x1870627099145088/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.242940:0:8834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8834:1870627099145088:0@lo:5: 00000004:00080000:2.0:1783969161.242952:0:8834:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783969161.242999:0:8834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e966300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8834:1870627099145472:0@lo:5: 00000100:00100000:2.0:1783969161.243028:0:8834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.243045:0:8834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.243057:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099145472 00000100:00100000:2.0:1783969161.243061:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099145472 00000100:00100000:2.0:1783969161.243523:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969161.243530:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8834:x1870627099145472:12345-0@lo:5: 00002000:00080000:2.0:1783969161.243557:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783969161.244144:0:8837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969161.244180:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099145344 00000100:00100000:0.0:1783969161.244185:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099145344 00000100:00100000:0.0:1783969161.244218:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783969161.244225:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:8837:x1870627099145344:12345-0@lo:502: 00000100:00100000:0.0:1783969161.244339:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:8837:x1870627099145344:12345-0@lo:502: Request processed in 114us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969161.244346:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783969161.246582:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8834:x1870627099145472:12345-0@lo:5: Request processed in 3046us (3546us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783969161.246596:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783969161.246712:0:8834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8e966300 x1870627099145472/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.246730:0:8834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e966300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8834:1870627099145472:0@lo:5: 00000004:00080000:2.0:1783969161.246747:0:8834:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1783969161.246793:0:8834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8834:1870627099145600:0@lo:900: 00000100:00100000:2.0:1783969161.246846:0:8834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.246870:0:8834:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.246890:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099145600 00000100:00100000:2.0:1783969161.246895:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099145600 00000100:00100000:2.0:1783969161.246929:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969161.246937:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8834:x1870627099145600:12345-0@lo:900: 00000100:00100000:0.0:1783969161.247328:0:8837:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.247881:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8834:x1870627099145600:12345-0@lo:900: Request processed in 941us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.247891:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969161.248010:0:8837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:8837:1870627099145344:0@lo:502: 00000020:01000000:0.0:1783969161.248084:0:8837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969161.248093:0:8837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969161.248096:0:8837:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783969161.248100:0:8837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:0.0:1783969161.249051:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783969161.249199:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969161.249216:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099145728:0@lo:13: 00000100:00100000:3.0:1783969161.249270:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969161.249307:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099145728 00000100:00100000:3.0:1783969161.249326:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099145728 00000100:00100000:3.0:1783969161.249406:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969161.249425:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1870627099145728:12345-0@lo:13: 00002000:00000024:3.0:1783969161.249449:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1783969161.249489:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1870627099145728:12345-0@lo:13: Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969161.249497:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783969161.249529:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8896b800 x1870627099145728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969161.249547:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099145728:0@lo:13: 00000004:00080000:3.0:1783969161.249565:0:8839:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783969161.249585:0:8839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8839:1870627099145856:0@lo:7: 00000100:00100000:3.0:1783969161.249626:0:8839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969161.249644:0:8839:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83e3bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969161.249731:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099145856 00000100:00100000:0.0:1783969161.249735:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099145856 00000100:00100000:0.0:1783969161.249760:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969161.249767:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8839:x1870627099145856:12345-0@lo:7: 00010000:00080000:2.0:1783969161.252417:0:8834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8e967800 x1870627099145600/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783969161.252442:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969161.252445:0:8834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8834:1870627099145600:0@lo:900: 00000020:01000000:3.0:1783969161.252461:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1783969161.252496:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783969161.252507:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.252518:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969161.252530:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783969161.252533:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93eaa5b00000 from 1 10000000:01000000:3.0:1783969161.252535:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783969161.252566:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.252585:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969161.252595:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969161.252614:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099145984:0@lo:101: 00000100:00100000:3.0:1783969161.252677:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969161.252735:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969161.252833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099145984 00000100:00100000:2.0:1783969161.252839:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099145984 00000100:00100000:2.0:1783969161.252885:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783969161.252895:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099145984:12345-0@lo:101: 00010000:00010000:2.0:1783969161.252907:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969161.252920:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb993e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.252957:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb993e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.252986:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb993e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.252995:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9600, rc 0) 00000100:00100000:2.0:1783969161.253038:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099145984:12345-0@lo:101: Request processed in 145us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969161.253052:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783969161.253094:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099145984:0@lo:101: 00010000:00010000:2.0:1783969161.253106:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.253115:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969161.253166:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099146112:0@lo:501: 00000100:00100000:2.0:1783969161.253199:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.253223:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969161.253328:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099146112 00000100:00100000:3.0:1783969161.253333:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099146112 00000100:00100000:3.0:1783969161.253369:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783969161.253377:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099146112:12345-0@lo:501: 00000100:00100000:3.0:1783969161.253532:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099146112:12345-0@lo:501: Request processed in 157us (332us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783969161.253539:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783969161.254554:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099146112:0@lo:501: 10000000:01000000:2.0:1783969161.254592:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783969161.254600:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969161.254607:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783969161.264191:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1783969161.264203:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1783969161.264312:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8839:x1870627099145856:12345-0@lo:7: Request processed in 14540us (14680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969161.264323:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783969161.267514:0:8839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea8896b800 x1870627099145856/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.267538:0:8839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8839:1870627099145856:0@lo:7: 00000004:00080000:2.0:1783969161.267555:0:8839:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783969161.267596:0:8839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8839:1870627099146240:0@lo:5: 00000100:00100000:2.0:1783969161.267658:0:8839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.267709:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099146240 00000100:00100000:2.0:1783969161.267717:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099146240 00000100:00100000:2.0:1783969161.267774:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969161.267783:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8839:x1870627099146240:12345-0@lo:5: 00002000:00080000:2.0:1783969161.267813:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783969161.267817:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783969161.268155:0:8839:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0c00 going to sleep for 11 seconds 00000001:00080000:0.0:1783969161.275218:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1783969161.275240:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1783969161.275245:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783969161.279029:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8839:x1870627099146240:12345-0@lo:5: Request processed in 11240us (11364us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783969161.279043:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783969161.279441:0:8839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab7414a80 x1870627099146240/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.279454:0:8839:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783969161.279460:0:8839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8839:1870627099146240:0@lo:5: 00000004:00080000:2.0:1783969161.279484:0:8839:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783969161.279530:0:8839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8839:1870627099146368:0@lo:700: 00000100:00100000:2.0:1783969161.279569:0:8839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969161.279607:0:8839:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969161.280177:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099146368 00000100:00100000:3.0:1783969161.280184:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099146368 00000100:00100000:3.0:1783969161.280232:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969161.280248:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8839:x1870627099146368:12345-0@lo:700: 00000100:00100000:1.0:1783969161.295830:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8839:x1870627099146368:12345-0@lo:700: Request processed in 15576us (16252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969161.295850:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783969161.296010:0:8839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab7414a80 x1870627099146368/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.296028:0:8839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8839:1870627099146368:0@lo:700: 00000004:02000040:3.0:1783969161.301580:0:8839:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1783969161.308340:0:8839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8839:1870627099146496:0@lo:5: 00000100:00100000:0.0:1783969161.308453:0:8839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969161.308504:0:8839:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969161.310297:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099146496 00000100:00100000:1.0:1783969161.310312:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099146496 00000100:00100000:1.0:1783969161.310378:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969161.310407:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8839:x1870627099146496:12345-0@lo:5: 00002000:00080000:0.0:1783969161.324176:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1783969161.324198:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1783969161.328498:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8839:x1870627099146496:12345-0@lo:5: Request processed in 18088us (20037us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783969161.328518:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783969161.328772:0:8839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab9176680 x1870627099146496/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969161.328790:0:8839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8839:1870627099146496:0@lo:5: 00000004:00080000:2.0:1783969161.328806:0:8839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:1.0:1783969161.670266:0:8865:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969161.670592:0:8865:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783969162.035488:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783969162.757916:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1783969163.056700:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969164.084960:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783969165.082449:0:8967:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969165.082651:0:8967:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783969165.105094:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969165.168538:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969165.171928:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099146624:0@lo:41: 00000100:00100000:2.0:1783969165.172012:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969165.177507:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099146624 00000100:00100000:0.0:1783969165.177523:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099146624 00000100:00100000:0.0:1783969165.177594:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783969165.177604:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099146624:12345-0@lo:41: 00000004:00000024:0.0:1783969165.177645:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1783969165.177729:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099146624:12345-0@lo:41: Request processed in 126us (5716us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969165.177852:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099146624:0@lo:41: 00000100:00100000:0.0:1783969165.177977:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783969165.680543:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969165.680575:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099146752:0@lo:41: 00000100:00100000:3.0:1783969165.680666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969165.680739:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099146752 00000100:00100000:3.0:1783969165.680768:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099146752 00000100:00100000:3.0:1783969165.680815:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969165.680823:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099146752:12345-0@lo:41: 00000004:00000024:3.0:1783969165.680859:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1783969165.680916:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099146752:12345-0@lo:41: Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969165.680924:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969165.680968:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099146752:0@lo:41: 00010000:00010000:1.0:1783969166.132073:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783969166.291039:0:9015:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969166.291049:0:9015:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1783969166.704858:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969166.704898:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099146880:0@lo:13: 00000100:00100000:2.0:1783969166.704971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969166.705966:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969166.705981:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099147008:0@lo:13: 00000100:00100000:0.0:1783969166.706045:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969166.706090:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099146880 00000100:00100000:0.0:1783969166.706096:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099146880 00000100:00100000:0.0:1783969166.706138:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099147008 00000100:00100000:0.0:1783969166.706141:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099147008 00000100:00100000:0.0:1783969166.706155:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969166.706162:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099146880:12345-0@lo:13: 00002000:00000024:0.0:1783969166.706188:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969166.706228:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099146880:12345-0@lo:13: Request processed in 66us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969166.706234:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969166.706247:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969166.706252:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099147008:12345-0@lo:13: 00002000:00000024:0.0:1783969166.706260:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969166.706279:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099147008:12345-0@lo:13: Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969166.706300:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783969166.706315:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783969166.706346:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab7210a80 x1870627099147008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969166.706356:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783969166.706376:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099147008:0@lo:13: 00010000:00080000:0.0:1783969166.706466:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab7416300 x1870627099146880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969166.706474:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1783969166.706485:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099146880:0@lo:13: 00000100:00100000:2.0:1783969166.715742:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099147520:0@lo:400: 00000100:00100000:2.0:1783969166.715816:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969166.715821:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099147392:0@lo:400: 00000100:00100000:1.0:1783969166.715867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969166.715883:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783969166.715901:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099147136:0@lo:400: 00000100:00100000:1.0:1783969166.715908:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099147904:0@lo:400: 00000100:00100000:3.0:1783969166.715973:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099147520 00000100:00100000:3.0:1783969166.715981:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099147520 00000100:00100000:0.0:1783969166.715999:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099147264:0@lo:400: 00000100:00100000:3.0:1783969166.716253:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969166.716261:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099147520:12345-0@lo:400: 00000100:00100000:1.0:1783969166.718405:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969166.718485:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099147392 00000100:00100000:1.0:1783969166.718754:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099147392 00000100:00100000:2.0:1783969166.718968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969166.719000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969166.719033:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099147776:0@lo:400: 00000100:00100000:0.0:1783969166.719063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969166.719094:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099147648:0@lo:400: 00000100:00100000:2.0:1783969166.719133:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969166.719138:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969166.719150:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099147392:12345-0@lo:400: 00000100:00100000:2.0:1783969166.719162:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099147904 00000100:00100000:2.0:1783969166.719167:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099147904 00000100:00100000:2.0:1783969166.719206:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099147264 00000100:00100000:2.0:1783969166.719210:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099147264 00000100:00100000:2.0:1783969166.719226:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099147776 00000100:00100000:1.0:1783969166.719227:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099147392:12345-0@lo:400: Request processed in 79us (3359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969166.719229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099147776 00000100:00100000:1.0:1783969166.719239:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783969166.719252:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969166.719261:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099147648 00000100:00100000:2.0:1783969166.719262:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099147904:12345-0@lo:400: 00000100:00100000:1.0:1783969166.719267:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099147648 00000100:00100000:1.0:1783969166.719290:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969166.719296:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099147648:12345-0@lo:400: 00000100:00100000:1.0:1783969166.719331:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099147648:12345-0@lo:400: Request processed in 35us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969166.719337:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969166.719378:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099147392:0@lo:400: 00000100:00100000:1.0:1783969166.719438:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783969166.719447:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1783969166.719464:0:7749:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783969166.719471:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099147904:12345-0@lo:400: Request processed in 211us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969166.719475:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783969166.719484:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969166.719488:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099147264:12345-0@lo:400: 00000100:00100000:2.0:1783969166.719505:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783969166.719515:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783969166.719523:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099147776:12345-0@lo:400: 00000100:00100000:1.0:1783969166.719529:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099147264:12345-0@lo:400: Request processed in 43us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969166.719537:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1783969166.719557:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969166.719561:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783969166.719661:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf747800 x1870627099147904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969166.719672:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099147904:0@lo:400: 00000100:00100000:1.0:1783969166.719852:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099147648:0@lo:400: 00000100:00100000:1.0:1783969166.719877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099147136 00000100:00100000:1.0:1783969166.719898:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099147136 00000100:00100000:1.0:1783969166.719931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783969166.719932:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099147776:12345-0@lo:400: Request processed in 408us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969166.719940:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3648:x1870627099147136:12345-0@lo:400: 00000100:00100000:2.0:1783969166.719952:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969166.719983:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3648:x1870627099147136:12345-0@lo:400: Request processed in 44us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969166.719991:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783969166.720023:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099147136:0@lo:400: 00010000:00080000:0.0:1783969166.720997:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf744a80 x1870627099147776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969166.721011:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099147776:0@lo:400: 00010000:00080000:0.0:1783969166.721036:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf747b80 x1870627099147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969166.721045:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099147264:0@lo:400: 00000100:00100000:3.0:1783969166.728129:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099147520:12345-0@lo:400: Request processed in 11856us (12300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969166.728150:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1783969166.728475:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf745880 x1870627099147520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969166.728493:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099147520:0@lo:400: 00010000:00010000:1.0:1783969167.152940:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969168.176876:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969169.201204:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969170.231276:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969170.292575:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969170.295547:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099148032:0@lo:41: 00000100:00100000:3.0:1783969170.295659:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969170.298908:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099148032 00000100:00100000:0.0:1783969170.298994:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099148032 00000100:00100000:0.0:1783969170.300089:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783969170.300122:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099148032:12345-0@lo:41: 00000004:00000024:0.0:1783969170.300185:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1783969170.300312:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099148032:12345-0@lo:41: Request processed in 198us (4653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969170.300320:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783969170.300451:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099148032:0@lo:41: 00000100:00100000:1.0:1783969170.801068:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969170.801108:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099148160:0@lo:41: 00000100:00100000:1.0:1783969170.801211:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969170.801529:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099148160 00000100:00100000:3.0:1783969170.801540:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099148160 00000100:00100000:3.0:1783969170.801617:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783969170.801628:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099148160:12345-0@lo:41: 00000004:00000024:3.0:1783969170.801684:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783969170.802319:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099148160:0@lo:41: 00000100:00100000:3.0:1783969170.802487:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099148160:12345-0@lo:41: Request processed in 860us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969170.802498:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1783969171.253874:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969171.830093:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969171.830159:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099148288:0@lo:13: 00000100:00100000:1.0:1783969171.830325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969171.830679:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099148544:0@lo:400: 00000100:00100000:1.0:1783969171.830730:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969171.830769:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099149056:0@lo:400: 00000100:00100000:1.0:1783969171.830790:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969171.830826:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783969171.830832:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099148672:0@lo:400: 00000100:00100000:1.0:1783969171.830868:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969171.830888:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099149184:0@lo:400: 00000100:00100000:1.0:1783969171.830908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969171.830977:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099148544 00000100:00100000:1.0:1783969171.830996:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099148544 00000100:00100000:1.0:1783969171.831096:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099149056 00000100:00100000:1.0:1783969171.831111:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099149056 00000100:00100000:1.0:1783969171.831169:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099149184 00000100:00100000:1.0:1783969171.831172:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099149184 00000100:00100000:3.0:1783969171.831177:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099148288 00000100:00100000:3.0:1783969171.831182:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099148288 00000100:00100000:1.0:1783969171.831206:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969171.831215:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099148544:12345-0@lo:400: 00000100:00100000:3.0:1783969171.831219:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969171.831226:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099148288:12345-0@lo:13: 00002000:00000024:3.0:1783969171.831250:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969171.831289:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099148288:12345-0@lo:13: Request processed in 64us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969171.831297:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969171.831302:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099148544:12345-0@lo:400: Request processed in 88us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969171.831321:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969171.831324:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099148800:0@lo:400: 00000100:00100000:3.0:1783969171.831351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969171.831357:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099148800 00000100:00100000:1.0:1783969171.831360:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099148800 00000100:00100000:3.0:1783969171.831364:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099149312:0@lo:400: 00000100:00100000:1.0:1783969171.831374:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969171.831406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969171.831423:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099149056:12345-0@lo:400: 00000100:00100000:3.0:1783969171.831426:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783969171.831432:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099148416:0@lo:400: 00000100:00100000:0.0:1783969171.831728:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099149312 00000100:00100000:0.0:1783969171.831733:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099149312 00000100:00100000:0.0:1783969171.831768:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969171.831775:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099149312:12345-0@lo:400: 00000100:00100000:1.0:1783969171.835118:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099149056:12345-0@lo:400: Request processed in 3721us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969171.835141:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969171.835157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969171.835191:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783969171.835212:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099149184:12345-0@lo:400: 00000100:00100000:3.0:1783969171.835224:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099148928:0@lo:400: 00000100:00080000:2.0:1783969171.835456:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969171.835463:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969171.835467:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969171.835482:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783969171.835494:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099148800:12345-0@lo:400: 00000100:00100000:3.0:1783969171.838290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969171.838360:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969171.838405:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099149440:0@lo:13: 00000100:00100000:3.0:1783969171.838457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969171.838511:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099148672 00000100:00100000:3.0:1783969171.838520:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099148672 00000100:00100000:3.0:1783969171.838575:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099148928 00000100:00100000:3.0:1783969171.838578:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099148928 00000100:00100000:3.0:1783969171.838598:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783969171.838607:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099148672:12345-0@lo:400: 00000100:00100000:3.0:1783969171.838668:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099148672:12345-0@lo:400: Request processed in 61us (7799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969171.838695:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783969171.838714:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783969171.838719:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099148928:12345-0@lo:400: 00000100:00100000:3.0:1783969171.838757:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099148928:12345-0@lo:400: Request processed in 37us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969171.838763:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783969171.838819:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099149440 00000100:00100000:3.0:1783969171.838823:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099149440 00000100:00100000:3.0:1783969171.838855:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969171.840596:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870627099149440:12345-0@lo:13: 00002000:00000024:3.0:1783969171.840651:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969171.840742:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870627099149440:12345-0@lo:13: Request processed in 1877us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969171.840754:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783969171.840852:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab7415500 x1870627099149440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969171.841072:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099149440:0@lo:13: 00000100:00100000:3.0:1783969171.841094:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099148928:0@lo:400: 00000100:00100000:1.0:1783969171.842217:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099149184:12345-0@lo:400: Request processed in 7006us (11295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969171.842235:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783969171.842318:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099148672:0@lo:400: 00010000:00080000:1.0:1783969171.842363:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea889e4380 x1870627099149184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969171.842374:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099149184:0@lo:400: 00010000:00080000:1.0:1783969171.842409:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981acb800 x1870627099148544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969171.842418:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099148544:0@lo:400: 00010000:00080000:1.0:1783969171.842432:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea889e7100 x1870627099149056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969171.842440:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099149056:0@lo:400: 00000100:00100000:2.0:1783969171.843328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099148800:12345-0@lo:400: Request processed in 7830us (11968us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969171.843340:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1783969171.843415:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981ac9500 x1870627099148288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969171.843437:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099148288:0@lo:13: 00000100:00100000:1.0:1783969171.843446:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099148416 00000100:00100000:1.0:1783969171.843455:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099148416 00000100:00100000:1.0:1783969171.843510:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783969171.843520:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3646:x1870627099148416:12345-0@lo:400: 00010000:00080000:3.0:1783969171.843524:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981ac8a80 x1870627099148800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969171.843534:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099148800:0@lo:400: 00000100:00100000:1.0:1783969171.843592:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3646:x1870627099148416:12345-0@lo:400: Request processed in 74us (8435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969171.843599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783969171.843633:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099148416:0@lo:400: 00000100:00100000:0.0:1783969171.844156:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099149312:12345-0@lo:400: Request processed in 12378us (12746us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969171.844168:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783969171.844513:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ea889e6d80 x1870627099149312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969171.844540:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099149312:0@lo:400: 00010000:00010000:2.0:1783969172.273887:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969173.301761:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969174.328816:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969175.344709:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969175.410102:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969175.410946:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099149568:0@lo:41: 00000100:00100000:3.0:1783969175.411021:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969175.416051:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099149568 00000100:00100000:0.0:1783969175.416078:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099149568 00000100:00100000:0.0:1783969175.416153:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783969175.416165:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099149568:12345-0@lo:41: 00000004:00000024:0.0:1783969175.416205:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1783969175.416297:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099149568:12345-0@lo:41: Request processed in 134us (5275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969175.416305:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783969175.416798:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099149568:0@lo:41: 00000100:00100000:3.0:1783969175.924042:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099149696:0@lo:41: 00000100:00100000:3.0:1783969175.924111:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969175.925477:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099149696 00000100:00100000:0.0:1783969175.925490:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099149696 00000100:00100000:0.0:1783969175.925554:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783969175.925564:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099149696:12345-0@lo:41: 00000004:00000024:0.0:1783969175.925614:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783969175.925687:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099149696:12345-0@lo:41: Request processed in 124us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969175.925695:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783969175.925769:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099149696:0@lo:41: 00000020:01000004:2.0:1783969176.318154:0:9515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783969176.318158:0:9515:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783969176.318159:0:9515:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783969176.318287:0:9515:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93e98212a000 00000020:01000004:2.0:1783969176.318303:0:9515:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783969176.318319:0:9515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783969176.318333:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93e982193380) 00000020:00000080:2.0:1783969176.318348:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783969176.370437:0:9515:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783969176.370494:0:9515:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:0.0:1783969176.375041:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:1.0:1783969176.410722:0:9515:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783969176.411076:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783969176.411090:0:9515:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783969176.411104:0:9515:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xea31253a47cb9953 00000020:01000004:1.0:1783969176.411110:0:9515:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783969176.411131:0:9515:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783969176.411134:0:9515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783969176.411146:0:9515:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783969176.411173:0:9515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1783969176.411177:0:9515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783969176.454190:0:9515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783969176.454228:0:9515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1783969176.454232:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783969176.454233:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783969176.454235:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969176.454236:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969176.454237:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969176.454238:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969176.454240:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969176.454241:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969176.454243:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969176.454244:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969176.454246:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783969176.454249:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1783969176.454251:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783969176.454253:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783969176.454254:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969176.454255:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969176.454256:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969176.454257:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969176.454258:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969176.454259:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969176.454260:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969176.454262:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969176.454262:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783969176.454289:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783969176.454308:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099149824:0@lo:253: 00000100:00100000:0.0:1783969176.454398:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.454781:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746000 going to sleep for 11 seconds 00000100:00100000:1.0:1783969176.455134:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099149824 00000100:00100000:1.0:1783969176.455143:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099149824 00000100:00100000:1.0:1783969176.455241:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783969176.455251:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:9515:x1870627099149824:12345-0@lo:253: 20000000:01000000:1.0:1783969176.455284:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783969176.455288:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1783969176.455294:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1783969176.455298:0:6516:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1783969176.455610:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969176.455766:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1783969176.455780:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1783969176.455797:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1783969176.455803:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1783969176.455826:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1783969176.455844:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1783969176.456014:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1783969176.456031:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:1.0:1783969176.456033:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:1.0:1783969176.456048:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1783969176.456054:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783969176.456069:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1783969176.456075:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:1.0:1783969176.456086:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1783969176.456092:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783969176.456103:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1783969176.456117:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1783969176.456203:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1783969176.456213:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:1.0:1783969176.456218:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:1.0:1783969176.456232:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1783969176.456238:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783969176.456249:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1783969176.456253:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:1.0:1783969176.456263:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1783969176.456268:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783969176.456279:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1783969176.456292:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1783969176.456668:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1783969176.456681:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:1.0:1783969176.456683:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:1.0:1783969176.456696:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1783969176.456702:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783969176.456715:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1783969176.456720:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:1.0:1783969176.456745:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1783969176.456751:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783969176.456763:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1783969176.456775:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1783969176.456786:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783969176.456788:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783969176.456791:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783969176.456847:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783969176.456849:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783969176.457719:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1783969176.457780:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1783969176.457796:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1783969176.458113:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1783969176.458134:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1783969176.458150:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1783969176.458161:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1783969176.458163:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783969176.466351:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1783969176.467700:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1783969176.467750:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1783969176.469184:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1783969176.469215:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1783969176.469229:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1783969176.469241:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783969176.469244:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783969176.469822:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1783969176.469847:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1783969176.469863:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1783969176.470170:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1783969176.470189:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1783969176.470203:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1783969176.470224:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783969176.470226:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783969176.470669:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1783969176.470822:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1783969176.470846:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1783969176.470862:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1783969176.470873:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783969176.470875:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783969176.471307:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1783969176.471342:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1783969176.471354:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1783969176.471618:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1783969176.471636:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1783969176.471648:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:1.0:1783969176.471663:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783969176.471682:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471702:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9849 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471709:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9873 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471715:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb98b2 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471721:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb98ce expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471739:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb98f8 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471746:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9914 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471752:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb993e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471759:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471805:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb993e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471830:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb993e expref: 21 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.471845:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099149952:0@lo:104: 00000100:00100000:1.0:1783969176.471919:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969176.471970:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9914 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.471978:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9914 expref: 21 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.471986:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150080:0@lo:104: 00000100:00100000:1.0:1783969176.472005:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969176.472034:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb98f8 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.472042:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb98f8 expref: 21 pid: 6516 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.472049:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150208:0@lo:104: 00000100:00100000:1.0:1783969176.472066:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969176.472093:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb98ce expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.472101:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb98ce expref: 21 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.472120:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150336:0@lo:104: 00000100:00100000:1.0:1783969176.472139:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969176.472154:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb98b2 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.472161:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb98b2 expref: 21 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.472168:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150464:0@lo:104: 00000100:00100000:1.0:1783969176.472185:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969176.472198:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9873 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.472205:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9873 expref: 21 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.472212:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150592:0@lo:104: 00000100:00100000:1.0:1783969176.472231:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969176.472244:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9849 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.472251:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9849 expref: 21 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.472258:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150720:0@lo:104: 00000100:00100000:1.0:1783969176.472286:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5ad7240 going to sleep for 11 seconds 00000100:00100000:0.0:1783969176.472353:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783969176.472371:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.472416:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099149952 00000100:00100000:0.0:1783969176.472422:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099149952 00000100:00100000:0.0:1783969176.472454:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099150080 00000100:00100000:0.0:1783969176.472457:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099150080 00000100:00100000:0.0:1783969176.472468:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099150208 00000100:00100000:0.0:1783969176.472470:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099150208 00000100:00100000:0.0:1783969176.472477:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099150336 00000100:00100000:0.0:1783969176.472479:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099150336 00000100:00100000:0.0:1783969176.472486:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099150464 00000100:00100000:0.0:1783969176.472488:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099150464 00000100:00100000:0.0:1783969176.472496:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099150592 00000100:00100000:0.0:1783969176.472497:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099150592 00000100:00100000:0.0:1783969176.472505:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099150720 00000100:00100000:0.0:1783969176.472507:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099150720 00000100:00100000:0.0:1783969176.472519:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783969176.472526:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6516:x1870627099149952:12345-0@lo:104: 00010000:00010000:0.0:1783969176.472538:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.472591:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969176.472596:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:6516:x1870627099149952:12345-0@lo:104: Request processed in 72us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.472603:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783969176.472618:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969176.472623:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+8:6516:x1870627099150080:12345-0@lo:104: 00010000:00010000:0.0:1783969176.472630:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.472659:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969176.472663:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+8:6516:x1870627099150080:12345-0@lo:104: Request processed in 41us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.472678:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969176.472690:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969176.472695:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+7:6516:x1870627099150208:12345-0@lo:104: 00010000:00010000:0.0:1783969176.472701:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.472744:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783969176.472749:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+7:6516:x1870627099150208:12345-0@lo:104: Request processed in 54us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.472758:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969176.472773:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783969176.472778:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:6516:x1870627099150336:12345-0@lo:104: 00010000:00010000:0.0:1783969176.472785:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.472808:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783969176.472812:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:6516:x1870627099150336:12345-0@lo:104: Request processed in 35us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.472817:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783969176.472828:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969176.472832:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:6516:x1870627099150464:12345-0@lo:104: 00010000:00010000:0.0:1783969176.472839:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.472861:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783969176.472864:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:6516:x1870627099150464:12345-0@lo:104: Request processed in 33us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.472875:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969176.472886:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783969176.472891:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6516:x1870627099150592:12345-0@lo:104: 00010000:00010000:0.0:1783969176.472897:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.472922:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1783969176.472927:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6516:x1870627099150592:12345-0@lo:104: Request processed in 37us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.472932:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783969176.472955:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783969176.472961:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6516:x1870627099150720:12345-0@lo:104: 00010000:00010000:0.0:1783969176.472968:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.472992:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1783969176.472996:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6516:x1870627099150720:12345-0@lo:104: Request processed in 36us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.473000:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1783969176.473018:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783969176.473023:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473030:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797e00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969176.473033:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473052:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969176.473059:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969176.473065:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969176.473098:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473104:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969176.473122:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473128:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eab7797e00/0xea31253a47cb993e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9945 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473140:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783969176.473143:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473148:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8200 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969176.473150:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473156:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969176.473162:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969176.473172:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969176.473184:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473189:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969176.473194:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473200:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb991b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473208:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783969176.473211:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473216:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176a00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969176.473219:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473225:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969176.473230:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969176.473234:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969176.473243:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473248:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969176.473267:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473273:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eac2176a00/0xea31253a47cb98f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473282:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783969176.473284:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473290:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601400 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969176.473293:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473299:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969176.473305:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969176.473311:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969176.473323:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473329:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969176.473333:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473340:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb98ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473348:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783969176.473357:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473362:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdfa00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969176.473365:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473371:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969176.473377:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969176.473404:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969176.473419:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473424:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969176.473429:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473435:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb98b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473445:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969176.473448:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473454:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969176.473456:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473471:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969176.473477:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969176.473481:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969176.473493:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473498:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969176.473501:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473507:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eac2176600/0xea31253a47cb9873 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb987a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473515:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969176.473517:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473521:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8800 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969176.473524:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473530:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969176.473536:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969176.473547:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969176.473559:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473564:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969176.473569:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473574:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9850 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.473586:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969176.473587:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969176.473589:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969176.473603:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099151232:0@lo:103: 00000100:00100000:0.0:1783969176.473639:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.473660:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783969176.473665:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099151104:0@lo:103: 00000100:00100000:0.0:1783969176.473684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.473696:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099151616:0@lo:103: 00000100:00100000:0.0:1783969176.473714:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969176.473822:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969176.473840:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099150848:0@lo:103: 00000100:00100000:3.0:1783969176.473868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.473895:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099151360:0@lo:103: 00000100:00100000:3.0:1783969176.473914:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.473926:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783969176.473931:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099150976:0@lo:103: 00000100:00100000:3.0:1783969176.473948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.473956:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099151488:0@lo:103: 00000100:00100000:3.0:1783969176.473972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.473996:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099151232 00000100:00100000:3.0:1783969176.474001:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099151232 00010000:00010000:3.0:1783969176.474021:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb98ce expref: 22 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.474036:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099151104 00000100:00100000:3.0:1783969176.474039:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099151104 00010000:00010000:3.0:1783969176.474049:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb98f8 expref: 23 pid: 6516 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.474058:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099151616 00000100:00100000:3.0:1783969176.474060:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099151616 00010000:00010000:3.0:1783969176.474068:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9849 expref: 24 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.474076:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099150848 00000100:00100000:3.0:1783969176.474078:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099150848 00010000:00010000:3.0:1783969176.474086:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb993e expref: 25 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.474094:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099151360 00000100:00100000:3.0:1783969176.474100:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099151360 00010000:00010000:3.0:1783969176.474112:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb98b2 expref: 26 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.474121:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099150976 00000100:00100000:3.0:1783969176.474123:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099150976 00010000:00010000:3.0:1783969176.474132:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9914 expref: 27 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.474140:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099151488 00000100:00100000:3.0:1783969176.474142:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099151488 00010000:00010000:3.0:1783969176.474150:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9873 expref: 28 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.474160:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969176.474165:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+28:3649:x1870627099151232:12345-0@lo:103: 00010000:00010000:3.0:1783969176.474176:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969176.474181:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb98ce expref: 28 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474190:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb98ce expref: 28 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474206:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969176.474236:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+28:3649:x1870627099151232:12345-0@lo:103: Request processed in 70us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.474242:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969176.474256:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969176.474262:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+27:3649:x1870627099151104:12345-0@lo:103: 00010000:00010000:3.0:1783969176.474269:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969176.474278:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb98f8 expref: 27 pid: 6516 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474286:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb98f8 expref: 27 pid: 6516 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474296:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969176.474317:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+27:3649:x1870627099151104:12345-0@lo:103: Request processed in 56us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.474323:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969176.474335:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969176.474341:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+26:3649:x1870627099151616:12345-0@lo:103: 00010000:00010000:3.0:1783969176.474347:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969176.474351:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9849 expref: 26 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474359:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9849 expref: 26 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474368:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969176.474411:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+26:3649:x1870627099151616:12345-0@lo:103: Request processed in 70us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.474416:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969176.474427:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969176.474432:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaac72e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:3646:x1870627099150848:12345-0@lo:103: 00010000:00010000:3.0:1783969176.474439:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969176.474443:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb993e expref: 25 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474461:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb993e expref: 25 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474470:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969176.474494:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaac72e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:3646:x1870627099150848:12345-0@lo:103: Request processed in 62us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.474500:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969176.474531:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783969176.474537:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099151360:12345-0@lo:103: 00010000:00010000:3.0:1783969176.474543:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969176.474547:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb98b2 expref: 24 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474555:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb98b2 expref: 24 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474563:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969176.474580:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099151360:12345-0@lo:103: Request processed in 44us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.474585:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783969176.474594:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783969176.474599:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:3646:x1870627099150976:12345-0@lo:103: 00010000:00010000:3.0:1783969176.474605:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969176.474609:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9914 expref: 23 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474617:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9914 expref: 23 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474632:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969176.474653:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:3646:x1870627099150976:12345-0@lo:103: Request processed in 54us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.474659:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783969176.474671:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969176.474677:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:3646:x1870627099151488:12345-0@lo:103: 00010000:00010000:3.0:1783969176.474684:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969176.474688:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9873 expref: 22 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474697:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9873 expref: 22 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474707:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474714:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474740:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474748:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474753:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474759:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474770:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601c00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969176.474775:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474781:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474789:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.474798:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969176.474822:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:3646:x1870627099151488:12345-0@lo:103: Request processed in 144us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.474827:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969176.474869:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099150976:0@lo:103: 00000100:00100000:3.0:1783969176.474878:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099151488:0@lo:103: 00000100:00100000:3.0:1783969176.474884:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099150848:0@lo:103: 00000100:00100000:3.0:1783969176.474890:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099151360:0@lo:103: 00000100:00100000:3.0:1783969176.474931:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099151104:0@lo:103: 00000100:00100000:3.0:1783969176.474939:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099151616:0@lo:103: 00000100:00100000:3.0:1783969176.474945:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099151232:0@lo:103: 00010000:00010000:1.0:1783969176.475222:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb993e expref: 21 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.475245:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099149952:0@lo:104: 00010000:00010000:1.0:1783969176.475257:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796000/0xea31253a47cb991b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9914 expref: 20 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.475265:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150080:0@lo:104: 00010000:00010000:1.0:1783969176.475274:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796400/0xea31253a47cb98ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb98f8 expref: 19 pid: 6516 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.475280:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150208:0@lo:104: 00010000:00010000:1.0:1783969176.475289:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb98d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb98ce expref: 18 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.475298:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150336:0@lo:104: 00010000:00010000:1.0:1783969176.475308:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad9400/0xea31253a47cb98b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb98b2 expref: 17 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.475315:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150464:0@lo:104: 00010000:00010000:1.0:1783969176.475323:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb987a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9873 expref: 16 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.475329:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150592:0@lo:104: 00010000:00010000:1.0:1783969176.475338:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eac2176800/0xea31253a47cb9850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9849 expref: 15 pid: 6514 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.475347:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1870627099150720:0@lo:104: 00010000:00010000:1.0:1783969176.475371:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.475412:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.475418:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.475424:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb995a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783969176.475437:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1783969176.475554:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969176.480506:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:9515:x1870627099149824:12345-0@lo:253: Request processed in 25247us (26114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969176.480521:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783969176.480645:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099149824:0@lo:253: 10000000:01000000:2.0:1783969176.480661:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783969176.480665:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969176.480666:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783969176.480667:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969176.480669:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1783969176.480670:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969176.480671:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969176.480672:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969176.480674:0:9515:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783969176.480676:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969176.480677:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783969176.480696:0:9515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93e98212a000 from lustre-OST0001 10000000:01000000:2.0:1783969176.480741:0:9515:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1783969176.480745:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783969176.480753:0:9515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93eaa5b00000 local copy 10000000:01000000:2.0:1783969176.480757:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783969176.480792:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.480802:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.480812:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969176.480837:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7416680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099151744:0@lo:101: 00000100:00100000:2.0:1783969176.480869:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969176.480909:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5b48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969176.481062:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099151744 00000100:00100000:1.0:1783969176.481068:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099151744 00000100:00100000:1.0:1783969176.481108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783969176.481116:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+14:9515:x1870627099151744:12345-0@lo:101: 00010000:00010000:1.0:1783969176.481127:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969176.481139:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb9968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9961 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.481160:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb9968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9961 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.481169:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb9968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9961 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.481179:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600c00, rc 0) 00000100:00100000:1.0:1783969176.481211:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099151744:12345-0@lo:101: Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969176.481229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783969176.481351:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7416680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099151744:0@lo:101: 00010000:00010000:3.0:1783969176.481363:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.481401:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.481482:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099151872:0@lo:501: 00000100:00100000:3.0:1783969176.481508:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.481525:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea860640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969176.481753:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099151872 00000100:00100000:1.0:1783969176.481757:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099151872 00000100:00100000:1.0:1783969176.481789:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783969176.481795:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099151872:12345-0@lo:501: 00000100:00100000:1.0:1783969176.481864:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099151872:12345-0@lo:501: Request processed in 68us (354us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783969176.481870:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783969176.482993:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099151872:0@lo:501: 10000000:01000000:3.0:1783969176.483013:0:9515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783969176.483046:0:9515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783969176.483055:0:9515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.483064:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.483071:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.483093:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783969176.483122:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93e98212a000 10000000:01000000:3.0:1783969176.483128:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783969176.483133:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783969176.483136:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969176.483141:0:9515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783969176.483143:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783969176.483169:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.483192:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.483203:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.483219:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152000:0@lo:101: 00000100:00100000:3.0:1783969176.483258:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.483298:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969176.483450:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099152000 00000100:00100000:2.0:1783969176.483455:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099152000 00000100:00100000:2.0:1783969176.483496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783969176.483505:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152000:12345-0@lo:101: 00010000:00010000:2.0:1783969176.483524:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969176.483535:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb996f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.483559:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb996f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.483571:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb996f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.483581:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9a00, rc 0) 00000100:00100000:2.0:1783969176.483620:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9515:x1870627099152000:12345-0@lo:101: Request processed in 116us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969176.483627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783969176.483795:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152000:0@lo:101: 00010000:00010000:3.0:1783969176.483807:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.483930:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969176.483939:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.483946:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969176.483949:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.483965:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969176.483973:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969176.483978:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969176.484003:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.484009:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969176.484046:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.484054:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea31253a47cb9968 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.484066:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969176.484067:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969176.484069:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969176.484078:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969176.484089:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099152128:0@lo:103: 00000100:00100000:0.0:1783969176.484119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.484155:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099152128 00000100:00100000:0.0:1783969176.484159:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099152128 00000100:00100000:0.0:1783969176.484191:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969176.484198:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3648:x1870627099152128:12345-0@lo:103: 00010000:00010000:0.0:1783969176.484209:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969176.484223:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b600c00/0xea31253a47cb9968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9961 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.484239:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969176.484265:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3648:x1870627099152128:12345-0@lo:103: Request processed in 67us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.484271:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969176.484308:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099152128:0@lo:103: 00010000:00010000:3.0:1783969176.484509:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.484592:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152256:0@lo:501: 00000100:00100000:3.0:1783969176.484621:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.484643:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969176.484695:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099152256 00000100:00100000:0.0:1783969176.484699:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099152256 00000100:00100000:0.0:1783969176.484831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783969176.484839:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152256:12345-0@lo:501: 00000100:00100000:0.0:1783969176.484958:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152256:12345-0@lo:501: Request processed in 120us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.484965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783969176.486499:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152256:0@lo:501: 00000100:00100000:3.0:1783969176.486566:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152384:0@lo:503: 00000100:00100000:3.0:1783969176.486662:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.495624:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969176.495693:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099152384 00000100:00100000:2.0:1783969176.495702:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099152384 00000100:00100000:2.0:1783969176.495763:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783969176.495773:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152384:12345-0@lo:503: 00000100:00100000:2.0:1783969176.497277:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152384:12345-0@lo:503: Request processed in 1499us (10608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969176.497289:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783969176.504152:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152384:0@lo:503: 00000040:00080000:3.0:1783969176.504591:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969176.504809:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152512:0@lo:502: 00000100:00100000:3.0:1783969176.505020:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.505112:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969176.506786:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099152512 00000100:00100000:0.0:1783969176.506800:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099152512 00000100:00100000:2.0:1783969176.510448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783969176.510478:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152512:12345-0@lo:502: 00000100:00100000:2.0:1783969176.511161:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152512:12345-0@lo:502: Request processed in 697us (6138us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969176.511171:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783969176.511312:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152512:0@lo:502: 00000040:00080000:1.0:1783969176.511591:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783969176.511623:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783969176.511638:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783969176.512141:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783969176.512164:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783969176.512179:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783969176.512218:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152640:0@lo:502: 00000100:00100000:1.0:1783969176.512279:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969176.512414:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5ad7840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969176.514419:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099152640 00000100:00100000:3.0:1783969176.514432:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099152640 00000100:00100000:3.0:1783969176.514495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783969176.514504:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152640:12345-0@lo:502: 00000100:00100000:3.0:1783969176.514957:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152640:12345-0@lo:502: Request processed in 384us (2608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.514967:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783969176.515286:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152640:0@lo:502: 00000040:00080000:1.0:1783969176.515377:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1783969176.515424:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1783969176.516147:0:9526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783969176.516157:0:9526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1783969176.516163:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969176.516166:0:9526:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1783969176.516172:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969176.516187:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93eab7163380) 00000020:00000080:0.0:1783969176.516213:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783969176.516220:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783969176.516282:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93e98212a000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1783969176.516306:0:9526:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783969176.516312:0:9526:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xea31253a47cb9984 00010000:00010000:1.0:1783969176.524369:0:9526:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1783969176.524777:0:9526:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1783969176.529573:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783969176.530016:0:9526:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1783969176.537142:0:9526:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1783969176.537522:0:9526:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1783969176.549774:0:9526:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1783969176.551623:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783969176.551637:0:9526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969176.554397:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969176.554408:0:9526:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783969176.554422:0:9526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969176.554429:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969176.554431:0:9526:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783969176.554434:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783969176.554436:0:9526:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783969176.554465:0:9526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969176.554469:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969176.554470:0:9526:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783969176.554473:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783969176.554673:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1783969176.554703:0:9515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783969176.554737:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.554756:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969176.554764:0:9515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e98212a000 from 1 10000000:01000000:0.0:1783969176.554766:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969176.554803:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.554811:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.554831:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969176.554854:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152768:0@lo:101: 00000100:00100000:0.0:1783969176.555115:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.555160:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969176.556329:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099152768 00000100:00100000:3.0:1783969176.556342:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099152768 00000100:00100000:3.0:1783969176.556422:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783969176.556434:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099152768:12345-0@lo:101: 00010000:00010000:3.0:1783969176.556449:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969176.556464:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb998b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.556500:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb998b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.556512:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb998b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.556521:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797800, rc 0) 00000100:00100000:3.0:1783969176.556578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9515:x1870627099152768:12345-0@lo:101: Request processed in 146us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.556584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783969176.556847:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152768:0@lo:101: 00010000:00010000:0.0:1783969176.556865:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969176.556875:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969176.557122:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152896:0@lo:501: 00000100:00100000:0.0:1783969176.557161:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.557197:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969176.558422:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099152896 00000100:00100000:3.0:1783969176.558434:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099152896 00000100:00100000:3.0:1783969176.558483:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783969176.558494:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9515:x1870627099152896:12345-0@lo:501: 00000100:00100000:0.0:1783969176.558810:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099152896:0@lo:501: 00000100:00100000:0.0:1783969176.558859:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153024:0@lo:503: 00000100:00100000:0.0:1783969176.559036:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.559066:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746600 going to sleep for 11 seconds 00000100:00100000:0.0:1783969176.559081:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099153024 00000100:00100000:0.0:1783969176.559085:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099153024 00000100:00100000:0.0:1783969176.559106:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783969176.559112:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153024:12345-0@lo:503: 00000100:00100000:0.0:1783969176.559196:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153024:12345-0@lo:503: Request processed in 84us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.559203:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783969176.559250:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153024:0@lo:503: 00000040:00080000:0.0:1783969176.559582:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969176.560759:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9515:x1870627099152896:12345-0@lo:501: Request processed in 151us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.560775:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783969176.561403:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153152:0@lo:502: 00000100:00100000:0.0:1783969176.561471:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.561509:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969176.563082:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099153152 00000100:00100000:3.0:1783969176.563094:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099153152 00000100:00100000:3.0:1783969176.563138:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783969176.563147:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9515:x1870627099153152:12345-0@lo:502: 00000100:00100000:3.0:1783969176.563296:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9515:x1870627099153152:12345-0@lo:502: Request processed in 149us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.563303:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783969176.563579:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153152:0@lo:502: 00000040:00080000:0.0:1783969176.563877:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783969176.563987:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783969176.564021:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153280:0@lo:502: 00000100:00100000:0.0:1783969176.564072:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.564107:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969176.564316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099153280 00000100:00100000:3.0:1783969176.564321:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099153280 00000100:00100000:3.0:1783969176.564355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783969176.564371:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9515:x1870627099153280:12345-0@lo:502: 00000100:00100000:3.0:1783969176.564487:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9515:x1870627099153280:12345-0@lo:502: Request processed in 116us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.564494:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783969176.568061:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153280:0@lo:502: 00000040:00080000:0.0:1783969176.568179:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783969176.568193:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783969176.570286:0:9530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969176.570320:0:9530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969176.570322:0:9530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783969176.570329:0:9530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93e98212a000 00000020:00000080:0.0:1783969176.570332:0:9530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969176.570345:0:9530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969176.570348:0:9530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969176.570349:0:9530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783969176.570353:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783969176.570656:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783969176.570685:0:9515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969176.570712:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.570724:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969176.570785:0:9515:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783969176.570788:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93e98212a000 10000000:01000000:1.0:1783969176.570791:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93e98212a000 10000000:01000000:1.0:1783969176.570794:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783969176.570800:0:9515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93e98212a000 from 1 10000000:01000000:1.0:1783969176.570802:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783969176.570844:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.570853:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.570863:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.570887:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153408:0@lo:101: 00000100:00100000:1.0:1783969176.571374:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969176.571444:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5ad7780 going to sleep for 11 seconds 00000100:00100000:2.0:1783969176.571537:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099153408 00000100:00100000:2.0:1783969176.571545:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099153408 00000100:00100000:2.0:1783969176.571595:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783969176.571605:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9515:x1870627099153408:12345-0@lo:101: 00010000:00010000:2.0:1783969176.571619:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969176.571633:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9999 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.571666:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9999 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.571676:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9999 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.571685:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9400, rc 0) 00000100:00100000:2.0:1783969176.571742:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153408:12345-0@lo:101: Request processed in 138us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969176.571749:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783969176.572029:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153408:0@lo:101: 00010000:00010000:1.0:1783969176.572045:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.572056:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969176.572165:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153536:0@lo:501: 00000100:00100000:1.0:1783969176.572192:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969176.572224:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5ad7780 going to sleep for 11 seconds 00000100:00100000:3.0:1783969176.572268:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099153536 00000100:00100000:3.0:1783969176.572272:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099153536 00000100:00100000:3.0:1783969176.572314:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783969176.572322:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153536:12345-0@lo:501: 00000100:00100000:3.0:1783969176.572455:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153536:12345-0@lo:501: Request processed in 134us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.572461:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783969176.572624:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153536:0@lo:501: 00000100:00100000:1.0:1783969176.572650:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153664:0@lo:503: 00000100:00100000:1.0:1783969176.572687:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969176.572714:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5ad7780 going to sleep for 11 seconds 00000100:00100000:3.0:1783969176.572763:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099153664 00000100:00100000:3.0:1783969176.572767:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099153664 00000100:00100000:3.0:1783969176.572801:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783969176.572809:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153664:12345-0@lo:503: 00000100:00100000:3.0:1783969176.573097:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153664:12345-0@lo:503: Request processed in 288us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.573103:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783969176.574039:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153664:0@lo:503: 00000040:00080000:2.0:1783969176.574314:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783969176.574723:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153792:0@lo:502: 00000100:00100000:2.0:1783969176.574802:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969176.575017:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b2900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969176.575310:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099153792 00000100:00100000:0.0:1783969176.575317:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099153792 00000100:00100000:0.0:1783969176.575367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783969176.575377:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153792:12345-0@lo:502: 00000100:00100000:0.0:1783969176.575519:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153792:12345-0@lo:502: Request processed in 143us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.575527:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783969176.575696:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153792:0@lo:502: 00000040:00080000:2.0:1783969176.576060:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783969176.576091:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783969176.576106:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783969176.576120:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783969176.576146:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783969176.576160:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783969176.576174:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783969176.576186:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783969176.576198:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783969176.576211:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783969176.576222:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783969176.576234:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783969176.576247:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783969176.576258:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783969176.576270:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783969176.576296:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783969176.576310:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783969176.576321:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783969176.576334:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783969176.576346:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783969176.576360:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783969176.576373:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783969176.576430:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783969176.576447:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783969176.576461:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1783969176.576474:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1783969176.576487:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1783969176.576500:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1783969176.576513:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1783969176.576528:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1783969176.576541:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1783969176.576567:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1783969176.576582:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1783969176.576594:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1783969176.576606:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1783969176.576618:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1783969176.576631:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1783969176.576655:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1783969176.576667:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1783969176.576678:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1783969176.576689:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1783969176.576702:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1783969176.576714:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1783969176.576738:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1783969176.576756:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1783969176.576768:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1783969176.576807:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153920:0@lo:502: 00000100:00100000:2.0:1783969176.577242:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969176.577286:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969176.577423:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099153920 00000100:00100000:1.0:1783969176.577430:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099153920 00000100:00100000:1.0:1783969176.577466:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783969176.577474:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153920:12345-0@lo:502: 00000100:00100000:1.0:1783969176.577592:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099153920:12345-0@lo:502: Request processed in 118us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969176.577599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783969176.577751:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099153920:0@lo:502: 00000040:00080000:2.0:1783969176.577805:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1783969176.577886:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1783969176.579233:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783969176.579249:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93eab92099c0) 00000020:00000080:3.0:1783969176.579271:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1783969176.579499:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93e98212a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783969176.579503:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93e98212a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783969176.579506:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93e98212a000 3 00010000:00080000:3.0:1783969176.579535:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eab6106000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1783969176.586664:0:9531:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1783969176.589060:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783969176.589118:0:9531:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783969176.589151:0:9531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xea31253a47cb99ae 00000100:00080000:3.0:1783969176.589163:0:9531:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969176.589169:0:9531:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93eab6106000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969176.589207:0:9531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf746d80 x1870627099154048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969176.589240:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783969176.589399:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099154048:0@lo:38: 00000100:00100000:0.0:1783969176.589471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.589529:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099154048 00000100:00100000:0.0:1783969176.589536:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099154048 00000100:00100000:0.0:1783969176.589569:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969176.589576:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870627099154048:12345-0@lo:38: 00010000:00080000:0.0:1783969176.589598:0:7749:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1783969176.589626:0:7749:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xea31253a47cb99b5 00000004:00100000:0.0:1783969176.589640:0:7749:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783969176.589668:0:7749:0:(import.c:65:import_set_state_nolock()) ffff93eab725f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969176.589718:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870627099154048:12345-0@lo:38: Request processed in 140us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.589736:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783969176.589781:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf746d80 x1870627099154048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969176.589798:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969176.589806:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1783969176.589822:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783969176.589827:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783969176.589829:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6106000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783969176.589835:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099154048:0@lo:38: 00000100:00100000:3.0:1783969176.590579:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099154176:0@lo:400: 00000100:00100000:3.0:1783969176.590619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.590647:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099154688:0@lo:400: 00000100:00100000:3.0:1783969176.590673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.590695:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783969176.590701:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099154304:0@lo:400: 00000100:00100000:3.0:1783969176.590740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.590760:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099154816:0@lo:400: 00000100:00100000:3.0:1783969176.590784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.590822:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099154176 00000100:00100000:3.0:1783969176.590827:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099154176 00000100:00100000:3.0:1783969176.590860:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099154688 00000100:00100000:3.0:1783969176.590863:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099154688 00000100:00100000:3.0:1783969176.591025:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969176.591035:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099154176:12345-0@lo:400: 00000100:00100000:3.0:1783969176.591086:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099154176:12345-0@lo:400: Request processed in 53us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.591093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969176.591116:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783969176.591122:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099154688:12345-0@lo:400: 00000100:00100000:3.0:1783969176.591148:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099154688:12345-0@lo:400: Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.591165:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783969176.591184:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099154304 00000100:00100000:3.0:1783969176.591188:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099154304 00000100:00100000:3.0:1783969176.591210:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783969176.591215:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099154304:12345-0@lo:400: 00000100:00100000:3.0:1783969176.591244:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099154304:12345-0@lo:400: Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.591249:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783969176.591266:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099154816 00000100:00100000:3.0:1783969176.591269:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099154816 00000100:00100000:0.0:1783969176.591413:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099154432:0@lo:400: 00000100:00100000:0.0:1783969176.591442:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.591461:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099154944:0@lo:400: 00000100:00100000:0.0:1783969176.591482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969176.591537:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099154432 00000100:00100000:1.0:1783969176.591541:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099154432 00000100:00100000:2.0:1783969176.591735:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099154560:0@lo:400: 00000100:00100000:2.0:1783969176.591766:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969176.596534:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099154944 00000100:00100000:2.0:1783969176.596546:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099154944 00000100:00100000:2.0:1783969176.596598:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969176.596608:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099154816:12345-0@lo:400: 00000100:00100000:2.0:1783969176.596685:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099154816:12345-0@lo:400: Request processed in 79us (5900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969176.596693:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969176.596711:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969176.596717:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099154944:12345-0@lo:400: 00000100:00100000:2.0:1783969176.596763:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099154944:12345-0@lo:400: Request processed in 47us (5280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969176.596783:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783969176.596839:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981ac9500 x1870627099154944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969176.596854:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099154944:0@lo:400: 00000100:00100000:1.0:1783969176.599050:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099154560 00000100:00100000:1.0:1783969176.599066:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099154560 00000100:00100000:1.0:1783969176.599124:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969176.599134:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099154432:12345-0@lo:400: 00000100:00100000:1.0:1783969176.599220:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099154432:12345-0@lo:400: Request processed in 88us (7777us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969176.599227:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969176.599242:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783969176.599248:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099154560:12345-0@lo:400: 00000100:00100000:1.0:1783969176.601094:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099154560:12345-0@lo:400: Request processed in 1833us (9314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969176.601107:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000020:01000004:3.0:1783969176.601300:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783969176.601318:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93eab920cd40) 00000020:00000080:3.0:1783969176.601343:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1783969176.601598:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93e98212a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783969176.601602:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93e98212a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783969176.601605:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93e98212a000 3 00010000:00080000:3.0:1783969176.601648:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93e983308000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.134@tcp at head 00000100:00100000:0.0:1783969176.604521:0:9533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1870627099155072:0@lo:901: 00000100:00100000:0.0:1783969176.604595:0:9533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969176.604648:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099155072 00000100:00100000:0.0:1783969176.604654:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099155072 00000100:00100000:0.0:1783969176.604702:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969176.604712:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1870627099155072:12345-0@lo:901: 00000100:00100000:0.0:1783969176.604848:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1870627099155072:12345-0@lo:901: Request processed in 137us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969176.604856:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969176.604883:0:9533:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746b40 going to sleep for 11 seconds 00010000:00080000:0.0:1783969176.604907:0:9533:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab779df80 x1870627099155072/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783969192 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969176.604921:0:9533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1870627099155072:0@lo:901: 00000100:00080000:1.0:1783969176.611963:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969176.611975:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969176.611978:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969176.612213:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099154304:0@lo:400: 00010000:00080000:1.0:1783969176.612236:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981aca680 x1870627099154816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969176.612247:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099154816:0@lo:400: 00010000:00080000:1.0:1783969176.612261:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981acb800 x1870627099154176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969176.612270:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099154176:0@lo:400: 00010000:00080000:1.0:1783969176.612281:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981aca300 x1870627099154688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969176.612289:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099154688:0@lo:400: 00010000:00080000:2.0:1783969176.614006:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981acad80 x1870627099154432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969176.614023:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099154432:0@lo:400: 00010000:00080000:2.0:1783969176.614062:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981ac9c00 x1870627099154560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969176.614072:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099154560:0@lo:400: 00010000:00010000:3.0:1783969176.615245:0:9531:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1783969176.615358:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1783969176.617712:0:9531:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783969176.617741:0:9531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xea31253a47cb99c3 00000100:00080000:3.0:1783969176.617753:0:9531:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969176.617759:0:9531:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93e983308000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969176.617797:0:9531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf744000 x1870627099155200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969176.617891:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783969176.618050:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1870627099155200:0@lo:38: 00000100:00100000:1.0:1783969176.618143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.618241:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099155200 00000100:00100000:3.0:1783969176.618247:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099155200 00000100:00100000:3.0:1783969176.618294:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969176.618300:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099155200:12345-0@lo:38: 00010000:00080000:3.0:1783969176.618324:0:6521:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1783969176.618353:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xea31253a47cb99ca 00000004:00100000:3.0:1783969176.618367:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783969176.618423:0:6521:0:(import.c:65:import_set_state_nolock()) ffff93e983308800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969176.618477:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870627099155200:12345-0@lo:38: Request processed in 175us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.618484:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783969176.618524:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf744000 x1870627099155200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969176.618535:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783969176.618543:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1783969176.618549:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783969176.618553:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783969176.618556:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e983308000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783969176.618561:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1870627099155200:0@lo:38: 00000040:00080000:3.0:1783969176.620231:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1783969176.621426:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1783969176.621465:0:9515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969176.621492:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969176.621504:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783969176.621574:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783969176.621577:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783969176.621578:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969176.621579:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969176.621581:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969176.621582:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969176.621584:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969176.621586:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783969176.621587:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783969176.621589:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969176.621590:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783969176.621595:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783969176.621597:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783969176.621599:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783969176.621600:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969176.621601:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969176.621602:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969176.621603:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969176.621604:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969176.621605:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783969176.621606:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783969176.621608:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969176.621609:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783969176.621634:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783969176.621652:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099155328:0@lo:253: 00000100:00100000:1.0:1783969176.621717:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969176.621772:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5ad7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969176.621795:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099155328 00000100:00100000:1.0:1783969176.621801:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099155328 00000100:00100000:1.0:1783969176.621854:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783969176.621862:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9515:x1870627099155328:12345-0@lo:253: 20000000:01000000:1.0:1783969176.621889:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783969176.621904:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783969176.629155:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783969176.629185:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783969176.629355:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783969176.629361:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783969176.629415:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.629434:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb98c0 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.629442:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9906 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.629450:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.629492:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9906 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.629518:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9906 expref: 17 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969176.629535:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7417100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099155456:0@lo:104: 00000100:00100000:2.0:1783969176.629611:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969176.629663:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb98c0 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969176.629673:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb98c0 expref: 17 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969176.629682:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099155584:0@lo:104: 00000100:00100000:2.0:1783969176.629704:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969176.629721:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b2900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969176.629953:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099155456 00000100:00100000:3.0:1783969176.629961:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099155456 00000100:00100000:3.0:1783969176.630012:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099155584 00000100:00100000:3.0:1783969176.630015:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099155584 00000100:00100000:3.0:1783969176.630029:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969176.630037:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6537:x1870627099155456:12345-0@lo:104: 00010000:00010000:3.0:1783969176.630049:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630119:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783969176.630125:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:6537:x1870627099155456:12345-0@lo:104: Request processed in 88us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.630132:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969176.630148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969176.630153:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6537:x1870627099155584:12345-0@lo:104: 00010000:00010000:3.0:1783969176.630160:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630191:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783969176.630196:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:6537:x1870627099155584:12345-0@lo:104: Request processed in 44us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.630202:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969176.630239:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7417100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099155456:0@lo:104: 00000100:00100000:3.0:1783969176.630249:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1870627099155584:0@lo:104: 00010000:00010000:3.0:1783969176.630270:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630287:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969176.630293:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630300:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad9c00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969176.630303:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630311:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969176.630325:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969176.630331:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969176.630361:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630367:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969176.630409:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630417:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb990d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630430:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969176.630433:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630439:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600800 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969176.630442:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630448:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969176.630455:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969176.630460:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969176.630480:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630486:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969176.630503:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630509:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb98c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb98c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.630523:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969176.630524:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969176.630526:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969176.630532:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969176.630549:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099155712:0@lo:103: 00000100:00100000:3.0:1783969176.630593:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.630637:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969176.630646:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099155840:0@lo:103: 00000100:00100000:3.0:1783969176.630670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.630704:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099155712 00000100:00100000:3.0:1783969176.630708:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099155712 00010000:00010000:3.0:1783969176.630738:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9906 expref: 18 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.630760:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099155840 00000100:00100000:3.0:1783969176.630763:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099155840 00010000:00010000:3.0:1783969176.630774:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb98c0 expref: 19 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.630791:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969176.630993:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:3649:x1870627099155712:12345-0@lo:103: 00010000:00010000:3.0:1783969176.631014:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969176.631020:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9906 expref: 19 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631031:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9906 expref: 19 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631045:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796c00/0xea31253a47cb990d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9906 expref: 19 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631057:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969176.631087:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3649:x1870627099155712:12345-0@lo:103: Request processed in 290us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.631093:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969176.631108:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969176.631113:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:3647:x1870627099155840:12345-0@lo:103: 00010000:00010000:3.0:1783969176.631120:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969176.631123:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb98c0 expref: 17 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631131:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb98c0 expref: 17 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631140:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb98c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb98c0 expref: 17 pid: 6515 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631150:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631157:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783969176.631176:0:7929:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012051864s 00010000:00010000:3.0:1783969176.631180:0:7929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631187:0:7929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631193:0:7929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631199:0:7929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631203:0:7929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad9600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969176.631207:0:7929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631214:0:7929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631225:0:7929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631233:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969176.631260:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3647:x1870627099155840:12345-0@lo:103: Request processed in 146us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.631267:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1783969176.631286:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631303:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969176.631309:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad9600/0xea31253a47cb99d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969176.631340:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099155840:0@lo:103: 00000100:00100000:3.0:1783969176.631366:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099155712:0@lo:103: 00000100:00100000:2.0:1783969176.631774:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:9515:x1870627099155328:12345-0@lo:253: Request processed in 9911us (10055us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969176.631784:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783969176.632006:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfed4274-bbe1-4392-be5b-cfbff577e88d:9515:1870627099155328:0@lo:253: 10000000:01000000:1.0:1783969176.632016:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783969176.632020:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783969176.632021:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783969176.632023:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969176.632024:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969176.632025:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969176.632026:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969176.632027:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969176.632029:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783969176.632030:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783969176.632032:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969176.632033:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783969176.632045:0:9515:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783969176.639289:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1783969176.639548:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1783969176.639972:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1783969176.640159:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1783969176.640359:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1783969176.644035:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1783969176.648970:0:9515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1783969176.678061:0:9515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783969176.678073:0:9515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783969176.678117:0:9515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783969176.678162:0:9515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783969176.678183:0:9515:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1783969176.678205:0:9515:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1783969176.679045:0:9515:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969176.679244:0:9515:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1783969176.946684:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099155968:0@lo:13: 00000100:00100000:3.0:1783969176.946771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.946857:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969176.946866:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099156096:0@lo:13: 00000100:00100000:3.0:1783969176.946893:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969176.946929:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099155968 00000100:00100000:3.0:1783969176.946935:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099155968 00000100:00100000:3.0:1783969176.946970:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099156096 00000100:00100000:3.0:1783969176.946973:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099156096 00000100:00100000:3.0:1783969176.946988:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969176.946996:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099155968:12345-0@lo:13: 00002000:00000024:3.0:1783969176.947024:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969176.947063:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099155968:12345-0@lo:13: Request processed in 67us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.947069:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969176.947085:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969176.947090:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099156096:12345-0@lo:13: 00002000:00000024:3.0:1783969176.947098:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969176.947129:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099156096:12345-0@lo:13: Request processed in 39us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969176.947135:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783969176.947165:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e981acb800 x1870627099156096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969176.947185:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099156096:0@lo:13: 00010000:00080000:3.0:1783969176.947210:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eab779df80 x1870627099155968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969176.947220:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099155968:0@lo:13: 00010000:00010000:3.0:1783969177.396606:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783969177.662863:0:9588:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969177.663110:0:9588:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783969178.416585:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969179.443483:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969180.465317:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969180.529159:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099156224:0@lo:41: 00000100:00100000:3.0:1783969180.529232:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969180.529448:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099156224 00000100:00100000:0.0:1783969180.529469:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099156224 00000100:00100000:0.0:1783969180.529956:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783969180.529973:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099156224:12345-0@lo:41: 00000004:00000024:0.0:1783969180.530020:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1783969180.530092:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099156224:12345-0@lo:41: Request processed in 123us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969180.530165:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099156224:0@lo:41: 00000100:00100000:0.0:1783969180.536867:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783969181.041877:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099156352:0@lo:41: 00000100:00100000:1.0:1783969181.041953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969181.042088:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099156352 00000100:00100000:3.0:1783969181.042096:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099156352 00000100:00100000:3.0:1783969181.042156:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783969181.042165:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099156352:12345-0@lo:41: 00000004:00000024:3.0:1783969181.042200:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1783969181.042252:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099156352:12345-0@lo:41: Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969181.042259:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783969181.042305:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099156352:0@lo:41: 00010000:00010000:2.0:1783969181.489206:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969182.064572:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099156480:0@lo:400: 00000100:00100000:2.0:1783969182.064661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.064710:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099156992:0@lo:400: 00000100:00100000:2.0:1783969182.064750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.064770:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099157504:0@lo:400: 00000100:00100000:2.0:1783969182.064794:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.064834:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783969182.064840:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099156864:0@lo:400: 00000100:00100000:2.0:1783969182.064876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.064892:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099157376:0@lo:400: 00000100:00100000:2.0:1783969182.064910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.064942:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099156608:0@lo:400: 00000100:00100000:2.0:1783969182.064962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.064976:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099157120:0@lo:400: 00000100:00100000:2.0:1783969182.064990:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.065001:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099157632:0@lo:400: 00000100:00100000:2.0:1783969182.065020:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.065032:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783969182.065037:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099156736:0@lo:400: 00000100:00100000:3.0:1783969182.065238:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099157504 00000100:00100000:3.0:1783969182.065245:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099157504 00000100:00100000:3.0:1783969182.065857:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099157376 00000100:00100000:3.0:1783969182.065862:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099157376 00000100:00100000:3.0:1783969182.066343:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969182.066368:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099157504:12345-0@lo:400: 00000100:00100000:3.0:1783969182.066463:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e967800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099157504:12345-0@lo:400: Request processed in 99us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969182.066470:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969182.066489:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969182.066494:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099157376:12345-0@lo:400: 00000100:00100000:3.0:1783969182.066521:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099157376:12345-0@lo:400: Request processed in 27us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969182.066526:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969182.066549:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099156864 00000100:00100000:3.0:1783969182.066553:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099156864 00000100:00100000:3.0:1783969182.066581:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099156608 00000100:00100000:3.0:1783969182.066584:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099156608 00000100:00100000:3.0:1783969182.066594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099157120 00000100:00100000:3.0:1783969182.066595:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099157120 00000100:00100000:3.0:1783969182.066605:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099157632 00000100:00100000:3.0:1783969182.066608:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099157632 00000100:00100000:3.0:1783969182.066622:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783969182.066628:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099156864:12345-0@lo:400: 00000100:00100000:3.0:1783969182.066670:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099156864:12345-0@lo:400: Request processed in 41us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969182.066676:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783969182.066688:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783969182.066694:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099156608:12345-0@lo:400: 00000100:00100000:3.0:1783969182.066721:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099156608:12345-0@lo:400: Request processed in 27us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969182.067833:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783969182.067859:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783969182.067881:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099157120:12345-0@lo:400: 00000100:00100000:3.0:1783969182.067941:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099157120:12345-0@lo:400: Request processed in 63us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969182.067948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783969182.067960:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783969182.067966:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099157632:12345-0@lo:400: 00000100:00100000:3.0:1783969182.067996:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099157632:12345-0@lo:400: Request processed in 30us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969182.068001:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1783969182.068024:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969182.068029:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969182.070674:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099156480 00000100:00100000:0.0:1783969182.070689:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099156480 00000100:00100000:0.0:1783969182.072990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783969182.073014:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3647:x1870627099156480:12345-0@lo:400: 00000100:00100000:0.0:1783969182.073192:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3647:x1870627099156480:12345-0@lo:400: Request processed in 189us (8531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969182.073200:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783969182.080970:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099156992 00000100:00100000:0.0:1783969182.080990:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099156992 00000100:00100000:0.0:1783969182.081068:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783969182.081081:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099156992:12345-0@lo:400: 00000100:00100000:0.0:1783969182.081193:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099156992:12345-0@lo:400: Request processed in 114us (16442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969182.081201:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783969182.081242:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099157888:0@lo:13: 00000100:00100000:0.0:1783969182.081299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969182.081337:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969182.081345:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099158016:0@lo:13: 00000100:00100000:0.0:1783969182.081370:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783969182.081444:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7414000 x1870627099156864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969182.081476:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099156864:0@lo:400: 00010000:00080000:0.0:1783969182.081492:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7416300 x1870627099157376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969182.081501:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099157376:0@lo:400: 00000100:00100000:0.0:1783969182.081513:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099156480:0@lo:400: 00000100:00100000:0.0:1783969182.081524:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099156992:0@lo:400: 00010000:00080000:0.0:1783969182.081535:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea88969180 x1870627099157504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969182.081543:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099157504:0@lo:400: 00000100:00100000:3.0:1783969182.083775:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099157888 00000100:00100000:3.0:1783969182.083789:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099157888 00000100:00100000:3.0:1783969182.083833:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099158016 00000100:00100000:3.0:1783969182.083837:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099158016 00000100:00100000:3.0:1783969182.083855:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783969182.083865:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099157888:12345-0@lo:13: 00002000:00000024:3.0:1783969182.083904:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969182.083990:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099157888:12345-0@lo:13: Request processed in 125us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969182.083997:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783969182.084013:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783969182.084019:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099158016:12345-0@lo:13: 00002000:00000024:3.0:1783969182.084029:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969182.084055:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099158016:12345-0@lo:13: Request processed in 36us (2684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969182.084061:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783969182.086965:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779ca80 x1870627099158016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969182.086993:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099158016:0@lo:13: 00010000:00080000:0.0:1783969182.087009:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981ac8a80 x1870627099157888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969182.087021:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099157888:0@lo:13: 00000100:00100000:2.0:1783969182.087169:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.087246:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099156736 00000100:00100000:2.0:1783969182.087265:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099156736 00000100:00100000:2.0:1783969182.087306:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783969182.087315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099156736:12345-0@lo:400: 00000100:00100000:2.0:1783969182.087408:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099156736:12345-0@lo:400: Request processed in 93us (22352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969182.087416:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783969182.087451:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099156736:0@lo:400: 00000100:00100000:2.0:1783969182.087462:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099157248:0@lo:400: 00000100:00100000:2.0:1783969182.087494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.087518:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099157248 00000100:00100000:2.0:1783969182.087522:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099157248 00000100:00100000:2.0:1783969182.087588:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783969182.087594:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099157248:12345-0@lo:400: 00000100:00100000:2.0:1783969182.087628:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099157248:12345-0@lo:400: Request processed in 34us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969182.087634:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1783969182.087662:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783969182.087682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7415500 x1870627099157248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969182.087692:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099157248:0@lo:400: 00000100:00100000:2.0:1783969182.087700:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099157760:0@lo:400: 00000100:00100000:2.0:1783969182.088207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969182.088236:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099157760 00000100:00100000:2.0:1783969182.088241:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099157760 00000100:00100000:2.0:1783969182.089463:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783969182.089477:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099157760:12345-0@lo:400: 00000100:00100000:2.0:1783969182.089570:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099157760:12345-0@lo:400: Request processed in 96us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969182.089577:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1783969182.089599:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783969182.089631:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8896b800 x1870627099157760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969182.089658:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099157760:0@lo:400: 00010000:00080000:2.0:1783969182.089675:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7415f80 x1870627099156608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969182.089685:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099156608:0@lo:400: 00010000:00080000:2.0:1783969182.089719:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7416680 x1870627099157120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969182.089738:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099157120:0@lo:400: 00010000:00080000:2.0:1783969182.089750:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea88968e00 x1870627099157632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969182.089759:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099157632:0@lo:400: 00010000:00010000:2.0:1783969182.513666:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969183.538862:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783969183.846625:0:9877:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783969184.560494:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783969185.118010:0:9930:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969185.118315:0:9930:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783969185.587845:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969185.651805:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969185.651833:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099158144:0@lo:41: 00000100:00100000:1.0:1783969185.651908:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969185.652634:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099158144 00000100:00100000:0.0:1783969185.652644:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099158144 00000100:00100000:0.0:1783969185.652720:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783969185.652731:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099158144:12345-0@lo:41: 00000004:00000024:0.0:1783969185.652767:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1783969185.652823:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099158144:12345-0@lo:41: Request processed in 95us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969185.652849:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783969185.653017:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099158144:0@lo:41: 00000100:00100000:1.0:1783969186.162762:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099158272:0@lo:41: 00000100:00100000:1.0:1783969186.162833:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.162901:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099158272 00000100:00100000:1.0:1783969186.162908:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099158272 00000100:00100000:1.0:1783969186.162950:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783969186.162958:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099158272:12345-0@lo:41: 00000004:00000024:1.0:1783969186.162989:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783969186.163030:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099158272:12345-0@lo:41: Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.163037:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783969186.163076:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099158272:0@lo:41: 10000000:01000000:0.0:1783969186.163644:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783969186.163649:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93eab70d7000 from 39 10000000:01000000:0.0:1783969186.163654:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783969186.163765:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969186.163777:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969186.163787:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969186.163821:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099158400:0@lo:101: 00000100:00100000:1.0:1783969186.163856:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.163892:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5b900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.163946:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099158400 00000100:00100000:3.0:1783969186.163952:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099158400 00000100:00100000:3.0:1783969186.163993:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783969186.164000:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099158400:12345-0@lo:101: 00010000:00010000:3.0:1783969186.164011:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969186.164024:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb99d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.164044:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb99d8 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.164055:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb99d8 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.164063:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796c00, rc 0) 00000100:00100000:3.0:1783969186.164105:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099158400:12345-0@lo:101: Request processed in 105us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.164111:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783969186.164279:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099158400:0@lo:101: 00010000:00010000:1.0:1783969186.164294:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969186.164302:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969186.164360:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099158528:0@lo:501: 00000100:00100000:1.0:1783969186.164420:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.164437:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5b900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.164544:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099158528 00000100:00100000:3.0:1783969186.164548:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099158528 00000100:00100000:3.0:1783969186.164589:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783969186.164596:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099158528:12345-0@lo:501: 00000100:00100000:3.0:1783969186.164891:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099158528:12345-0@lo:501: Request processed in 294us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.164897:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783969186.165147:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099158528:0@lo:501: 00000100:00100000:0.0:1783969186.165177:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099158656:0@lo:503: 00000100:00100000:0.0:1783969186.165224:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.165254:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285300 going to sleep for 11 seconds 00000100:00100000:1.0:1783969186.166050:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099158656 00000100:00100000:1.0:1783969186.166057:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099158656 00000100:00100000:1.0:1783969186.166101:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783969186.166109:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099158656:12345-0@lo:503: 00000100:00100000:1.0:1783969186.166225:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099158656:12345-0@lo:503: Request processed in 116us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.166232:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783969186.166290:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099158656:0@lo:503: 00000100:00100000:2.0:1783969186.168305:0:9963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9963:1870627099158784:0@lo:502: 00000100:00100000:2.0:1783969186.170823:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.170871:0:9963:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.171564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099158784 00000100:00100000:0.0:1783969186.171586:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099158784 00000100:00100000:0.0:1783969186.171654:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783969186.171665:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9963:x1870627099158784:12345-0@lo:502: 00000100:00100000:0.0:1783969186.171823:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9963:x1870627099158784:12345-0@lo:502: Request processed in 160us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.171831:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783969186.172215:0:9963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9963:1870627099158784:0@lo:502: 00000100:00100000:2.0:1783969186.172291:0:9963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9963:1870627099158912:0@lo:502: 00000100:00100000:2.0:1783969186.172335:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.172398:0:9963:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.172428:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099158912 00000100:00100000:0.0:1783969186.172433:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099158912 00000100:00100000:0.0:1783969186.172470:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783969186.172477:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9963:x1870627099158912:12345-0@lo:502: 00000100:00100000:0.0:1783969186.172554:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:9963:x1870627099158912:12345-0@lo:502: Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.172561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783969186.174200:0:9963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9963:1870627099158912:0@lo:502: 00000040:00080000:2.0:1783969186.174250:0:9963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1783969186.174395:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1783969186.174423:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783969186.174434:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.174459:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969186.174470:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783969186.174473:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1783969186.174476:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783969186.174514:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.174523:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.174533:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969186.174553:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159040:0@lo:101: 00000100:00100000:0.0:1783969186.174626:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.174669:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285540 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.174805:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099159040 00000100:00100000:3.0:1783969186.174813:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099159040 00000100:00100000:3.0:1783969186.174866:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783969186.174875:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099159040:12345-0@lo:101: 00010000:00010000:3.0:1783969186.174896:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969186.174910:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb99e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.174933:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb99e6 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.174943:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb99e6 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.174951:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797200, rc 0) 00000100:00100000:3.0:1783969186.174996:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099159040:12345-0@lo:101: Request processed in 122us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.175003:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783969186.175783:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159040:0@lo:101: 00010000:00010000:2.0:1783969186.175802:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.175813:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.175896:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159168:0@lo:501: 00000100:00100000:2.0:1783969186.175933:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.175971:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.175983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099159168 00000100:00100000:0.0:1783969186.175987:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099159168 00000100:00100000:0.0:1783969186.176060:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783969186.176068:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099159168:12345-0@lo:501: 00000100:00100000:0.0:1783969186.176204:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099159168:12345-0@lo:501: Request processed in 136us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.176211:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783969186.178832:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159168:0@lo:501: 00000100:00100000:2.0:1783969186.178896:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159296:0@lo:503: 00000100:00100000:2.0:1783969186.178967:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.185551:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.188743:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099159296 00000100:00100000:3.0:1783969186.188758:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099159296 00000100:00100000:3.0:1783969186.188814:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783969186.188824:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099159296:12345-0@lo:503: 00000100:00100000:3.0:1783969186.188982:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099159296:12345-0@lo:503: Request processed in 159us (10015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.188990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783969186.189129:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159296:0@lo:503: 00000100:00100000:3.0:1783969186.189889:0:9966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9966:1870627099159424:0@lo:502: 00000100:00100000:3.0:1783969186.189942:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.189970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099159424 00000100:00100000:3.0:1783969186.189980:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099159424 00000100:00100000:3.0:1783969186.190003:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783969186.190009:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9966:x1870627099159424:12345-0@lo:502: 00000100:00100000:3.0:1783969186.190087:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9966:x1870627099159424:12345-0@lo:502: Request processed in 77us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.190094:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783969186.190139:0:9966:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9826463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.190153:0:9966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9966:1870627099159424:0@lo:502: 00000020:01000000:3.0:1783969186.190175:0:9966:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969186.191520:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969186.191527:0:9966:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783969186.191548:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783969186.191551:0:9966:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783969186.191600:0:9966:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9966:1870627099159552:0@lo:502: 00000100:00100000:3.0:1783969186.191736:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.191764:0:9966:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9826463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.191869:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099159552 00000100:00100000:0.0:1783969186.191876:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099159552 00000100:00100000:0.0:1783969186.191925:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783969186.191941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9966:x1870627099159552:12345-0@lo:502: 00000100:00100000:0.0:1783969186.192046:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:9966:x1870627099159552:12345-0@lo:502: Request processed in 107us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.192053:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783969186.192156:0:9966:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9966:1870627099159552:0@lo:502: 00000020:01000000:3.0:1783969186.192183:0:9966:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969186.192508:0:9966:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969186.192510:0:9966:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783969186.192517:0:9966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1783969186.192736:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1783969186.192760:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783969186.192772:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.192783:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969186.192793:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783969186.192796:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93eab929d800 from 39 10000000:01000000:0.0:1783969186.192798:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783969186.192832:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.192840:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.192848:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969186.192863:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159680:0@lo:101: 00000100:00100000:0.0:1783969186.192902:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.192932:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.192947:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099159680 00000100:00100000:0.0:1783969186.192951:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099159680 00000100:00100000:0.0:1783969186.192989:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783969186.192995:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099159680:12345-0@lo:101: 00010000:00010000:0.0:1783969186.193008:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969186.193021:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb99f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.193059:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb99f4 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.193070:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb99f4 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.193079:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdec00, rc 0) 00000100:00100000:0.0:1783969186.193110:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099159680:12345-0@lo:101: Request processed in 115us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.193116:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783969186.193158:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159680:0@lo:101: 00010000:00010000:0.0:1783969186.193171:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.193180:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969186.193229:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159808:0@lo:501: 00000100:00100000:0.0:1783969186.193252:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.193264:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.193274:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099159808 00000100:00100000:0.0:1783969186.193277:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099159808 00000100:00100000:0.0:1783969186.193292:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783969186.193304:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099159808:12345-0@lo:501: 00000100:00100000:0.0:1783969186.196556:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099159808:12345-0@lo:501: Request processed in 3242us (3293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.196582:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783969186.196753:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159808:0@lo:501: 00000100:00100000:0.0:1783969186.196808:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159936:0@lo:503: 00000100:00100000:0.0:1783969186.196851:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.196872:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.196885:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099159936 00000100:00100000:0.0:1783969186.196891:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099159936 00000100:00100000:0.0:1783969186.196921:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783969186.196928:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099159936:12345-0@lo:503: 00000100:00100000:0.0:1783969186.197024:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099159936:12345-0@lo:503: Request processed in 95us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.197031:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783969186.197069:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099159936:0@lo:503: 00000100:00100000:0.0:1783969186.197260:0:9967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9967:1870627099160064:0@lo:502: 00000100:00100000:0.0:1783969186.197292:0:9967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.197309:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099160064 00000100:00100000:0.0:1783969186.197313:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099160064 00000100:00100000:0.0:1783969186.197333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783969186.197339:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:9967:x1870627099160064:12345-0@lo:502: 00000100:00100000:0.0:1783969186.200841:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:9967:x1870627099160064:12345-0@lo:502: Request processed in 3491us (3537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.200857:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783969186.200937:0:9967:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab72859c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.200971:0:9967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9967:1870627099160064:0@lo:502: 00000100:00100000:0.0:1783969186.201042:0:9967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9967:1870627099160192:0@lo:502: 00000100:00100000:0.0:1783969186.201085:0:9967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.201115:0:9967:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab72859c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.201939:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099160192 00000100:00100000:2.0:1783969186.201948:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099160192 00000100:00100000:2.0:1783969186.201987:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783969186.201994:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:9967:x1870627099160192:12345-0@lo:502: 00000100:00100000:2.0:1783969186.202125:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:9967:x1870627099160192:12345-0@lo:502: Request processed in 130us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.202132:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783969186.202292:0:9967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9967:1870627099160192:0@lo:502: 00000040:00080000:0.0:1783969186.202323:0:9967:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1783969186.203926:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1783969186.203955:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783969186.203965:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.203977:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969186.203987:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783969186.203990:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93eab929d800 from 6 10000000:01000000:2.0:1783969186.203992:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783969186.204031:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.204046:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.204058:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.204079:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160320:0@lo:101: 00000100:00100000:2.0:1783969186.204132:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.204176:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280180 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.204352:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099160320 00000100:00100000:0.0:1783969186.204358:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099160320 00000100:00100000:0.0:1783969186.204418:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783969186.204427:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099160320:12345-0@lo:101: 00010000:00010000:0.0:1783969186.204440:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969186.204454:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdea00/0xea31253a47cb9a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9a02 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.204474:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdea00/0xea31253a47cb9a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9a02 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.204485:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdea00/0xea31253a47cb9a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a02 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.204493:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdea00, rc 0) 00000100:00100000:0.0:1783969186.204527:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099160320:12345-0@lo:101: Request processed in 102us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.204533:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783969186.204583:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160320:0@lo:101: 00010000:00010000:0.0:1783969186.204596:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.204612:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969186.204666:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160448:0@lo:256: 00000100:00100000:0.0:1783969186.204694:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.204708:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.209585:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099160448 00000100:00100000:2.0:1783969186.209603:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099160448 00000100:00100000:2.0:1783969186.209784:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783969186.209796:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099160448:12345-0@lo:256: 20000000:01000000:2.0:1783969186.209825:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783969186.209850:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783969186.209853:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1783969186.210027:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099160448:12345-0@lo:256: Request processed in 232us (5329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.210034:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783969186.210079:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160448:0@lo:256: 10000000:01000000:2.0:1783969186.210135:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783969186.210145:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.210156:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969186.210176:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783969186.210178:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1783969186.210181:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783969186.210229:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.210238:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.210248:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.210268:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160576:0@lo:101: 00000100:00100000:2.0:1783969186.210304:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.215324:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.216108:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099160576 00000100:00100000:3.0:1783969186.216119:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099160576 00000100:00100000:3.0:1783969186.216166:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783969186.216176:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099160576:12345-0@lo:101: 00010000:00010000:3.0:1783969186.216241:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969186.216321:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9a10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.216367:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9a10 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.216447:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a10 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.216456:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796e00, rc 0) 00000100:00100000:3.0:1783969186.216523:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099160576:12345-0@lo:101: Request processed in 348us (6217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.216529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783969186.218856:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160576:0@lo:101: 00010000:00010000:2.0:1783969186.218890:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.218903:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.218997:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160704:0@lo:501: 00000100:00100000:2.0:1783969186.219054:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.223493:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.225872:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099160704 00000100:00100000:3.0:1783969186.225888:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099160704 00000100:00100000:0.0:1783969186.226800:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783969186.226814:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099160704:12345-0@lo:501: 00000100:00100000:0.0:1783969186.227042:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099160704:12345-0@lo:501: Request processed in 231us (7986us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.227051:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783969186.227177:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160704:0@lo:501: 00000100:00100000:3.0:1783969186.227230:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160832:0@lo:503: 00000100:00100000:3.0:1783969186.227276:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.227315:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9826466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.227515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099160832 00000100:00100000:2.0:1783969186.227522:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099160832 00000100:00100000:2.0:1783969186.227562:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783969186.227588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099160832:12345-0@lo:503: 00000100:00100000:2.0:1783969186.227678:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099160832:12345-0@lo:503: Request processed in 92us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.227685:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783969186.227745:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099160832:0@lo:503: 00000100:00100000:3.0:1783969186.228557:0:9970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9970:1870627099160960:0@lo:502: 00000100:00100000:3.0:1783969186.228617:0:9970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.228665:0:9970:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982646840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.228800:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099160960 00000100:00100000:0.0:1783969186.228805:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099160960 00000100:00100000:0.0:1783969186.228844:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783969186.228851:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:9970:x1870627099160960:12345-0@lo:502: 00000100:00100000:0.0:1783969186.228948:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:9970:x1870627099160960:12345-0@lo:502: Request processed in 97us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.228955:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783969186.229049:0:9970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9970:1870627099160960:0@lo:502: 00000020:01000000:3.0:1783969186.229078:0:9970:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783969186.229085:0:9970:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783969186.229092:0:9970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969186.229095:0:9970:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783969186.229110:0:9970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783969186.229114:0:9970:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:3.0:1783969186.229134:0:9970:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783969186.229136:0:9970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969186.229160:0:9970:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93e9834e99c0) 00000020:00000080:3.0:1783969186.229185:0:9970:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1783969186.229190:0:9970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783969186.229271:0:9970:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783969186.229277:0:9970:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783969186.229283:0:9970:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cb9a25 00010000:00080000:3.0:1783969186.229313:0:9970:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eabf76a800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1783969186.229588:0:9970:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1783969186.230914:0:9970:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783969186.230932:0:9970:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783969186.231094:0:9970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969186.231254:0:9970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969186.231405:0:9970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783969186.231492:0:9970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783969186.233563:0:9971:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969186.233581:0:9971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783969186.237834:0:9970:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783969186.237850:0:9970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783969186.237893:0:9970:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783969186.237917:0:9970:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cb9a2c 00000100:00080000:3.0:1783969186.237928:0:9970:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969186.237934:0:9970:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93eabf76a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969186.237970:0:9970:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983491500 x1870627099161088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969186.238002:0:9970:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783969186.238051:0:9970:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969186.238060:0:9970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969186.238062:0:9970:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783969186.238065:0:9970:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969186.238069:0:9970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969186.238071:0:9970:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783969186.238074:0:9970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783969186.238076:0:9970:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783969186.238104:0:9970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983492680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9970:1870627099161216:0@lo:502: 00000100:00100000:3.0:1783969186.238182:0:9970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.238217:0:9970:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.238526:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099161216 00000100:00100000:2.0:1783969186.238532:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099161216 00000100:00100000:2.0:1783969186.238587:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783969186.238597:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:9970:x1870627099161216:12345-0@lo:502: 00000100:00100000:2.0:1783969186.238733:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:9970:x1870627099161216:12345-0@lo:502: Request processed in 137us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.238741:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783969186.238924:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099161088:0@lo:8: 00000100:00100000:1.0:1783969186.238962:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.238999:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099161728:0@lo:400: 00000100:00100000:1.0:1783969186.239029:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.239047:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099162240:0@lo:400: 00000100:00100000:1.0:1783969186.239096:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.239114:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783969186.239120:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099161600:0@lo:400: 00000100:00100000:1.0:1783969186.239148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.239169:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099162112:0@lo:400: 00000100:00100000:1.0:1783969186.239194:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.239222:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099161728 00000100:00100000:1.0:1783969186.239227:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099161728 00000100:00100000:1.0:1783969186.239265:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099162240 00000100:00100000:1.0:1783969186.239268:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099162240 00000100:00100000:1.0:1783969186.239287:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099161600 00000100:00100000:1.0:1783969186.239290:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099161600 00000100:00100000:1.0:1783969186.239303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969186.239309:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099161728:12345-0@lo:400: 00000100:00100000:1.0:1783969186.239347:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099161728:12345-0@lo:400: Request processed in 39us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.239353:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969186.239365:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969186.239371:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099162240:12345-0@lo:400: 00000100:00100000:1.0:1783969186.239414:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099162240:12345-0@lo:400: Request processed in 44us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.239415:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099161344:0@lo:400: 00000100:00100000:1.0:1783969186.239421:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969186.239432:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783969186.239437:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099161600:12345-0@lo:400: 00000100:00100000:0.0:1783969186.239443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.239455:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099161856:0@lo:400: 00000100:00100000:1.0:1783969186.239460:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099161600:12345-0@lo:400: Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.239464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783969186.239472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.239480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099161344 00000100:00100000:0.0:1783969186.239481:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099162368:0@lo:400: 00000100:00100000:1.0:1783969186.239483:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099161344 00000100:00100000:1.0:1783969186.239494:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099161856 00000100:00100000:1.0:1783969186.239497:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099161856 00000100:00100000:0.0:1783969186.239503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.239508:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783969186.239513:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099161344:12345-0@lo:400: 00000100:00100000:0.0:1783969186.239521:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783969186.239527:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099161472:0@lo:400: 00000100:00100000:1.0:1783969186.239537:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099161344:12345-0@lo:400: Request processed in 24us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.239543:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783969186.239547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.239552:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099162368 00000100:00100000:1.0:1783969186.239555:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099162368 00000100:00100000:0.0:1783969186.239564:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099161984:0@lo:400: 00000100:00100000:1.0:1783969186.239581:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783969186.239588:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099161856:12345-0@lo:400: 00000100:00100000:0.0:1783969186.239598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.239654:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099161088 00000100:00100000:2.0:1783969186.239658:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099161088 00000100:00100000:2.0:1783969186.239673:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099162112 00000100:00100000:2.0:1783969186.239675:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099162112 00000100:00100000:2.0:1783969186.239688:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099161984 00000100:00100000:2.0:1783969186.239691:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099161984 00000100:00100000:2.0:1783969186.239704:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969186.239709:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099162112:12345-0@lo:400: 00000100:00100000:3.0:1783969186.239823:0:9970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983492680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9970:1870627099161216:0@lo:502: 00000020:01000000:3.0:1783969186.239861:0:9970:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969186.239867:0:9970:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969186.239869:0:9970:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783969186.239873:0:9970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00010000:00080000:0.0:1783969186.240859:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262d500 x1870627099161344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969186.240876:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099161344:0@lo:400: 00000100:00100000:0.0:1783969186.240917:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783969186.240930:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099162368:12345-0@lo:400: 00000100:00100000:0.0:1783969186.240982:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099162368:12345-0@lo:400: Request processed in 57us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.240989:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783969186.241010:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783969186.241019:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1783969186.241041:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262c380 x1870627099162368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969186.241052:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099162368:0@lo:400: 00000100:00100000:0.0:1783969186.242806:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969186.242821:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099161984:12345-0@lo:400: 00000100:00100000:0.0:1783969186.242893:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099161984:12345-0@lo:400: Request processed in 77us (3293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.242901:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969186.242926:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783969186.242934:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969186.242939:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1870627099161088:12345-0@lo:8: 00010000:00080000:0.0:1783969186.242975:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:0.0:1783969186.243006:0:8439:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cb9a33 00002000:00100000:0.0:1783969186.243023:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93eab725c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1783969186.243028:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1783969186.243033:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1783969186.243100:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783969186.243620:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:2.0:1783969186.243722:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099162112:12345-0@lo:400: Request processed in 4009us (4524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.243730:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000000:2.0:1783969186.243752:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1783969186.243777:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783969186.243788:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.243798:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969186.243815:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783969186.243818:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93ea912c9800 from 39 10000000:01000000:2.0:1783969186.243821:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783969186.243853:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.243861:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.243869:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.243886:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099162496:0@lo:101: 00000100:00100000:2.0:1783969186.243925:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.243967:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.244263:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099162496 00000100:00100000:3.0:1783969186.244271:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099162496 00000100:00100000:3.0:1783969186.244312:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783969186.244319:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099162496:12345-0@lo:101: 00010000:00010000:3.0:1783969186.244329:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969186.244341:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9a3a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.244361:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9a3a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.244371:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a3a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969186.244406:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797400, rc 0) 00000100:00100000:3.0:1783969186.244443:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099162496:12345-0@lo:101: Request processed in 125us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.244450:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1783969186.244563:0:8439:0:(import.c:65:import_set_state_nolock()) ffff93eab725b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969186.244626:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1870627099161088:12345-0@lo:8: Request processed in 1685us (5662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.244633:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969186.244723:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099162496:0@lo:101: 00010000:00010000:2.0:1783969186.244738:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.244747:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.244796:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099162624:0@lo:501: 00000100:00100000:2.0:1783969186.244818:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783969186.244878:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983491500 x1870627099161088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969186.244889:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783969186.244896:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1783969186.244903:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783969186.244909:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783969186.244911:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eabf76a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783969186.244925:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783969186.244930:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099161088:0@lo:8: 00000004:00080000:3.0:1783969186.244952:0:9971:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783969186.245007:0:9971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 248372625008ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783969186.245013:0:9971:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783969186.245886:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099161856:12345-0@lo:400: Request processed in 6292us (6406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.245897:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1783969186.245930:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969186.245935:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969186.245937:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969186.245955:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099161472 00000100:00100000:1.0:1783969186.245960:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099161472 00000100:00100000:1.0:1783969186.245998:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783969186.246004:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099161472:12345-0@lo:400: 00000100:00100000:1.0:1783969186.246052:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099161472:12345-0@lo:400: Request processed in 49us (6504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.246057:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1783969186.246085:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262ce00 x1870627099161600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969186.246098:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099161600:0@lo:400: 00010000:00080000:1.0:1783969186.246123:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262f480 x1870627099162112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969186.246131:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099162112:0@lo:400: 00010000:00080000:1.0:1783969186.246142:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262f100 x1870627099161728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969186.246150:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099161728:0@lo:400: 00010000:00080000:1.0:1783969186.246159:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262c700 x1870627099162240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969186.246166:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099162240:0@lo:400: 00000100:00100000:2.0:1783969186.251040:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.251323:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099162624 00000100:00100000:2.0:1783969186.251332:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099162624 00000100:00100000:2.0:1783969186.251409:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783969186.251424:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099162624:12345-0@lo:501: 00000100:00100000:2.0:1783969186.251618:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099162624:12345-0@lo:501: Request processed in 194us (6797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.251626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783969186.251683:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099162624:0@lo:501: 00000100:00100000:2.0:1783969186.251727:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099162752:0@lo:503: 00000100:00100000:2.0:1783969186.251765:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.251777:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.251787:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099162752 00000100:00100000:2.0:1783969186.251790:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099162752 00000100:00100000:2.0:1783969186.251807:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783969186.251812:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099162752:12345-0@lo:503: 00000100:00100000:2.0:1783969186.251888:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099162752:12345-0@lo:503: Request processed in 75us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.251894:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783969186.251929:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099162752:0@lo:503: 00000100:00100000:2.0:1783969186.251980:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1870627099162880:0@lo:700: 00000100:00100000:2.0:1783969186.252007:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.252021:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.254628:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099161472:0@lo:400: 00010000:00080000:0.0:1783969186.254661:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262c000 x1870627099161984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969186.254673:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099161984:0@lo:400: 00010000:00080000:0.0:1783969186.254687:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262d180 x1870627099161856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969186.254696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099161856:0@lo:400: 00000100:00100000:3.0:1783969186.263592:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099162880 00000100:00100000:3.0:1783969186.263607:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099162880 00000100:00100000:3.0:1783969186.263699:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969186.263710:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9972:x1870627099162880:12345-0@lo:700: 00000100:00100000:3.0:1783969186.263772:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8446:1870627099163008:0@lo:700: 00000100:00100000:3.0:1783969186.263844:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.263872:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9826466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.264610:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099163008 00000100:00100000:0.0:1783969186.264618:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099163008 00000100:00080000:1.0:1783969186.264822:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969186.265595:0:9976:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9976:1870627099163136:0@lo:502: 00000100:00100000:2.0:1783969186.265669:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.265701:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099163136 00000100:00100000:2.0:1783969186.265706:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099163136 00000100:00100000:2.0:1783969186.265740:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783969186.265749:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:9976:x1870627099163136:12345-0@lo:502: 00000100:00100000:2.0:1783969186.265886:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:9976:x1870627099163136:12345-0@lo:502: Request processed in 137us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.265894:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783969186.265947:0:9976:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.265968:0:9976:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9976:1870627099163136:0@lo:502: 00000100:00100000:2.0:1783969186.266007:0:9976:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9976:1870627099163264:0@lo:502: 00000100:00100000:2.0:1783969186.266040:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.266053:0:9976:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280180 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.266486:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969186.266498:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8446:x1870627099163008:12345-0@lo:700: 00000100:00100000:0.0:1783969186.266709:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099163264 00000100:00100000:0.0:1783969186.266714:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099163264 00000100:00100000:0.0:1783969186.266747:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783969186.266763:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:9976:x1870627099163264:12345-0@lo:502: 00000100:00100000:0.0:1783969186.266873:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:9976:x1870627099163264:12345-0@lo:502: Request processed in 109us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.266880:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783969186.267155:0:9976:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9976:1870627099163264:0@lo:502: 00000040:00080000:2.0:1783969186.267184:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1783969186.267244:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1783969186.267265:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783969186.267276:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.267287:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969186.267296:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783969186.267298:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93ea912c9800 from 6 10000000:01000000:2.0:1783969186.267301:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783969186.267329:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.267337:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.267447:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.267473:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163392:0@lo:101: 00000100:00100000:2.0:1783969186.267508:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.267533:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.267547:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099163392 00000100:00100000:2.0:1783969186.267551:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099163392 00000100:00100000:2.0:1783969186.267590:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783969186.267597:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099163392:12345-0@lo:101: 00010000:00010000:2.0:1783969186.267607:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969186.267619:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9a4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9a48 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.267642:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9a48 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.267653:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a48 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.267662:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9600, rc 0) 00000100:00100000:2.0:1783969186.267690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099163392:12345-0@lo:101: Request processed in 94us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.267696:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783969186.267729:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163392:0@lo:101: 00010000:00010000:2.0:1783969186.267741:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.267749:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.267798:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163520:0@lo:256: 00000100:00100000:2.0:1783969186.267828:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.267841:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280180 going to sleep for 11 seconds 00000004:00080000:1.0:1783969186.268153:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1783969186.269608:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099163520 00000100:00100000:0.0:1783969186.269619:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099163520 00000100:00100000:0.0:1783969186.269728:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783969186.269739:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099163520:12345-0@lo:256: 20000000:01000000:0.0:1783969186.269762:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783969186.269779:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783969186.269782:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1783969186.269893:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099163520:12345-0@lo:256: Request processed in 156us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.269902:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783969186.269953:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163520:0@lo:256: 10000000:01000000:0.0:1783969186.270002:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783969186.270012:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.270023:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969186.270033:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783969186.270035:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1783969186.270038:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783969186.270065:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.270082:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.270092:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969186.270110:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163648:0@lo:101: 00000100:00100000:0.0:1783969186.270141:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.270168:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.270182:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099163648 00000100:00100000:0.0:1783969186.270185:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099163648 00000100:00100000:0.0:1783969186.270205:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783969186.270211:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099163648:12345-0@lo:101: 00010000:00010000:0.0:1783969186.270219:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969186.270231:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9a56 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.270250:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9a56 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.270260:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a56 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.271607:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde000, rc 0) 00000100:00100000:0.0:1783969186.271748:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099163648:12345-0@lo:101: Request processed in 1534us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.271756:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783969186.275806:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163648:0@lo:101: 00010000:00010000:0.0:1783969186.275844:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969186.275858:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969186.275938:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163776:0@lo:501: 00000100:00100000:0.0:1783969186.275993:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969186.276035:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8b0780 going to sleep for 11 seconds 40000000:02000000:0.0:1783969186.278483:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1783969186.281713:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099163776 00000100:00100000:2.0:1783969186.281729:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099163776 00000100:00100000:2.0:1783969186.281828:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783969186.281839:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099163776:12345-0@lo:501: 00000100:00100000:2.0:1783969186.282023:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099163776:12345-0@lo:501: Request processed in 185us (6028us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.282032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783969186.289932:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163776:0@lo:501: 00000100:00100000:1.0:1783969186.290009:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163904:0@lo:503: 00000100:00100000:1.0:1783969186.290089:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.290134:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ec8240 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.290210:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099163904 00000100:00100000:2.0:1783969186.290219:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099163904 00000100:00100000:2.0:1783969186.290275:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783969186.290286:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099163904:12345-0@lo:503: 00000100:00100000:2.0:1783969186.290441:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099163904:12345-0@lo:503: Request processed in 156us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.290448:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783969186.290495:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099163904:0@lo:503: 00000100:00100000:1.0:1783969186.292198:0:9980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9980:1870627099164032:0@lo:502: 00000100:00100000:1.0:1783969186.292279:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.292320:0:9980:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ec8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.292371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099164032 00000100:00100000:2.0:1783969186.292476:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099164032 00000100:00100000:2.0:1783969186.292518:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783969186.292528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:9980:x1870627099164032:12345-0@lo:502: 00000100:00100000:2.0:1783969186.292690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:9980:x1870627099164032:12345-0@lo:502: Request processed in 163us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.292699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783969186.294007:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8446:x1870627099163008:12345-0@lo:700: Request processed in 27507us (30158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.294017:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783969186.294065:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983491500 x1870627099163008/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969186.294079:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8446:1870627099163008:0@lo:700: 40000000:02000000:0.0:1783969186.294091:0:8446:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1783969186.297342:0:9980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9980:1870627099164032:0@lo:502: 00000020:01000000:1.0:1783969186.297414:0:9980:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783969186.297422:0:9980:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783969186.297429:0:9980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969186.297432:0:9980:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783969186.297437:0:9980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783969186.297447:0:9980:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:1.0:1783969186.297474:0:9980:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783969186.297477:0:9980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783969186.297494:0:9980:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93eab7558000) 00000020:00000080:1.0:1783969186.297520:0:9980:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1783969186.297525:0:9980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783969186.297645:0:9980:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783969186.297652:0:9980:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783969186.297659:0:9980:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cb9a6b 00010000:00080000:1.0:1783969186.297696:0:9980:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eab9f03000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1783969186.297927:0:9980:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1783969186.298094:0:9980:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783969186.298110:0:9980:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783969186.298280:0:9980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969186.298427:0:9980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969186.298564:0:9980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783969186.298684:0:9980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1783969186.300881:0:9983:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969186.300888:0:9983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783969186.305951:0:9980:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783969186.305968:0:9980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783969186.306011:0:9980:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783969186.306039:0:9980:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cb9a72 00000100:00080000:1.0:1783969186.306052:0:9980:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783969186.306058:0:9980:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93eab9f03000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969186.306093:0:9980:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e981a45f80 x1870627099164160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783969186.306115:0:9980:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783969186.306162:0:9980:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969186.306166:0:9980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969186.306173:0:9980:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783969186.306177:0:9980:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969186.306181:0:9980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969186.306182:0:9980:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783969186.306185:0:9980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783969186.306187:0:9980:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783969186.306218:0:9980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9980:1870627099164288:0@lo:502: 00000100:00100000:1.0:1783969186.306299:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.306335:0:9980:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969186.306360:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099164288 00000100:00100000:1.0:1783969186.306366:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099164288 00000100:00100000:1.0:1783969186.306426:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783969186.306435:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:9980:x1870627099164288:12345-0@lo:502: 00000100:00100000:1.0:1783969186.306549:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:9980:x1870627099164288:12345-0@lo:502: Request processed in 114us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.306556:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783969186.306626:0:9980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:9980:1870627099164288:0@lo:502: 00000020:01000000:1.0:1783969186.306647:0:9980:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969186.306651:0:9980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969186.306653:0:9980:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783969186.306656:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1783969186.306848:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1783969186.306876:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783969186.306886:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.306897:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969186.306906:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783969186.306909:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93eaa5b00000 from 1 10000000:01000000:2.0:1783969186.306912:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783969186.306936:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.306945:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.306954:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.306967:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099164416:0@lo:101: 00000100:00100000:2.0:1783969186.306996:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.307015:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab72809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.307027:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099164416 00000100:00100000:2.0:1783969186.307030:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099164416 00000100:00100000:2.0:1783969186.307064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783969186.307072:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099164416:12345-0@lo:101: 00010000:00010000:2.0:1783969186.307081:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969186.307093:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9a79 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.307127:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9a79 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.307138:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a79 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.307147:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad8c00, rc 0) 00000100:00100000:2.0:1783969186.307175:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099164416:12345-0@lo:101: Request processed in 103us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.307182:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783969186.307210:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099164416:0@lo:101: 00010000:00010000:2.0:1783969186.307223:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.307232:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.307276:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099164544:0@lo:501: 00000100:00100000:2.0:1783969186.307298:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.307309:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5480 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.307320:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099164544 00000100:00100000:2.0:1783969186.307323:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099164544 00000100:00100000:2.0:1783969186.307343:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783969186.307349:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099164544:12345-0@lo:501: 00000100:00100000:2.0:1783969186.307437:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099164544:12345-0@lo:501: Request processed in 87us (137us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969186.307454:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783969186.307483:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099164544:0@lo:501: 10000000:01000000:2.0:1783969186.307503:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783969186.307509:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969186.307518:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969186.308465:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099164160:0@lo:8: 00000100:00100000:2.0:1783969186.308515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.310004:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099164160 00000100:00100000:3.0:1783969186.310013:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099164160 00000100:00100000:3.0:1783969186.310053:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783969186.310061:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1870627099164160:12345-0@lo:8: 00010000:00080000:3.0:1783969186.310092:0:9974:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:3.0:1783969186.310125:0:9974:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cb9a87 00002000:00100000:3.0:1783969186.310139:0:9974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93e98330f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783969186.310144:0:9974:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783969186.310146:0:9974:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000001:00100000:1.0:1783969186.314841:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783969186.315129:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9972:x1870627099162880:12345-0@lo:700: Request processed in 51415us (63114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969186.315143:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783969186.315198:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262ea00 x1870627099162880/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969186.315213:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1870627099162880:0@lo:700: 00002000:00080000:3.0:1783969186.315888:0:9974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783969186.315918:0:9974:0:(import.c:65:import_set_state_nolock()) ffff93e983309000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969186.315973:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1870627099164160:12345-0@lo:8: Request processed in 5911us (7457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.315982:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1783969186.316132:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a45f80 x1870627099164160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969186.316144:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969186.316152:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783969186.316162:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783969186.316168:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783969186.316170:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9f03000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783969186.316191:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783969186.316203:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099164160:0@lo:8: 00000004:00080000:1.0:1783969186.318254:0:9983:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783969186.318304:0:9983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 248445922786ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783969186.318313:0:9983:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1783969186.325013:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1783969186.334034:0:9984:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783969186.334070:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983493100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1870627099164800:0@lo:7: 00000100:00100000:3.0:1783969186.334139:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.334166:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982646840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.334214:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099164672:0@lo:13: 00000100:00100000:2.0:1783969186.334245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.334411:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099164672 00000100:00100000:3.0:1783969186.334419:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099164672 00000100:00100000:3.0:1783969186.334479:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969186.334489:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099164672:12345-0@lo:13: 00002000:00000024:3.0:1783969186.334518:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00010000:00080000:2.0:1783969186.334913:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983490e00 x1870627099164672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969186.334934:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099164672:0@lo:13: 00000100:00100000:3.0:1783969186.335007:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099164672:12345-0@lo:13: Request processed in 80us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.335016:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1783969186.335039:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969186.337209:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099164800 00000100:00100000:0.0:1783969186.337225:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099164800 00000100:00100000:0.0:1783969186.337278:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783969186.337288:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9984:x1870627099164800:12345-0@lo:7: 00000004:00080000:2.0:1783969186.350331:0:9972:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783969186.350362:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1870627099165056:0@lo:7: 00000100:00100000:2.0:1783969186.350453:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.350497:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.350517:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099165056 00000100:00100000:2.0:1783969186.350525:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099165056 00000100:00100000:2.0:1783969186.350582:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969186.350592:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9972:x1870627099165056:12345-0@lo:7: 00000100:00100000:1.0:1783969186.350895:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969186.350908:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099164928:0@lo:13: 00000100:00100000:1.0:1783969186.350939:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.350968:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099164928 00000100:00100000:1.0:1783969186.350981:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099164928 00000100:00100000:1.0:1783969186.351006:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783969186.351010:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1870627099164928:12345-0@lo:13: 00002000:00000024:1.0:1783969186.351023:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1783969186.351061:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1870627099164928:12345-0@lo:13: Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.351067:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1783969186.351104:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262ce00 x1870627099164928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969186.351124:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099164928:0@lo:13: 00000001:00100000:2.0:1783969186.352217:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00080000:0.0:1783969186.361115:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1783969186.361127:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783969186.361239:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9984:x1870627099164800:12345-0@lo:7: Request processed in 23946us (27093us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.361249:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1783969186.361778:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983493100 x1870627099164800/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969186.361792:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983493100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1870627099164800:0@lo:7: 00000004:00080000:3.0:1783969186.361806:0:9984:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783969186.361851:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983493100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1870627099165184:0@lo:5: 00000100:00100000:3.0:1783969186.361884:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969186.361902:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982646840 going to sleep for 11 seconds 00000100:00100000:1.0:1783969186.361975:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099165184 00000100:00100000:1.0:1783969186.361982:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099165184 00000100:00100000:1.0:1783969186.362030:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969186.362039:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9984:x1870627099165184:12345-0@lo:5: 00002000:00080000:1.0:1783969186.362064:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783969186.362068:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:1.0:1783969186.368604:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1783969186.368616:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1783969186.368712:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9972:x1870627099165056:12345-0@lo:7: Request processed in 18116us (18254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969186.368724:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1783969186.368913:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262c380 x1870627099165056/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969186.368928:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1870627099165056:0@lo:7: 00000004:00080000:2.0:1783969186.368943:0:9972:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783969186.368979:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1870627099165312:0@lo:5: 00000100:00100000:2.0:1783969186.369010:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.369046:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.369094:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099165312 00000100:00100000:0.0:1783969186.369108:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099165312 00000100:00100000:0.0:1783969186.369156:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969186.369164:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9972:x1870627099165312:12345-0@lo:5: 00002000:00080000:0.0:1783969186.369188:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1783969186.369228:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9972:x1870627099165312:12345-0@lo:5: Request processed in 65us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.369234:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783969186.369293:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262c380 x1870627099165312/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969186.369315:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1870627099165312:0@lo:5: 00000004:00080000:2.0:1783969186.369323:0:9972:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783969186.369342:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1870627099165440:0@lo:5: 00000100:00100000:2.0:1783969186.369363:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.369415:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969186.369475:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099165440 00000100:00100000:0.0:1783969186.369479:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099165440 00000100:00100000:0.0:1783969186.369497:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969186.369502:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9972:x1870627099165440:12345-0@lo:5: 00002000:00080000:0.0:1783969186.369524:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1783969186.370941:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9972:x1870627099165440:12345-0@lo:5: Request processed in 1433us (1572us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783969186.370950:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1783969186.371129:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262c380 x1870627099165440/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969186.371144:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9972:1870627099165440:0@lo:5: 00000004:00080000:2.0:1783969186.371155:0:9972:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1783969186.371189:0:9972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9972:1870627099165568:0@lo:900: 00000100:00100000:2.0:1783969186.371220:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.371245:0:9972:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.371592:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9984:x1870627099165184:12345-0@lo:5: Request processed in 9553us (9705us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783969186.371601:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1783969186.371687:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983493100 x1870627099165184/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969186.371698:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983493100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1870627099165184:0@lo:5: 00000004:00080000:2.0:1783969186.371707:0:9984:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783969186.371730:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1870627099165696:0@lo:700: 00000100:00100000:2.0:1783969186.371770:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969186.371797:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824b23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969186.371900:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099165696 00000100:00100000:3.0:1783969186.371905:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099165696 00000100:00100000:3.0:1783969186.371950:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969186.371959:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9984:x1870627099165696:12345-0@lo:700: 00000100:00100000:0.0:1783969186.374332:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099165568 00000100:00100000:0.0:1783969186.374345:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099165568 00000100:00100000:0.0:1783969186.374555:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969186.374578:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9972:x1870627099165568:12345-0@lo:900: 00000100:00100000:0.0:1783969186.374684:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9972:x1870627099165568:12345-0@lo:900: Request processed in 120us (3463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969186.374691:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783969186.374758:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262d180 x1870627099165568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969186.374773:0:9972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9972:1870627099165568:0@lo:900: 00000001:00080000:1.0:1783969186.374962:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:1.0:1783969186.374972:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1783969186.375073:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9984:x1870627099165696:12345-0@lo:700: Request processed in 3115us (3303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969186.375081:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783969186.378268:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262e680 x1870627099165696/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969186.378285:0:9984:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783969186.378304:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1870627099165696:0@lo:700: 00000004:02000040:1.0:1783969186.381821:0:9984:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1783969186.385123:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a46d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1870627099165824:0@lo:5: 00000100:00100000:1.0:1783969186.385190:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969186.388031:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969186.389497:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099165824 00000100:00100000:2.0:1783969186.389511:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099165824 00000100:00100000:2.0:1783969186.389587:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783969186.389598:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9984:x1870627099165824:12345-0@lo:5: 00002000:00080000:3.0:1783969186.406421:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1783969186.406450:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1783969186.412121:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9984:x1870627099165824:12345-0@lo:5: Request processed in 22519us (26924us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783969186.412134:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1783969186.412267:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a46d80 x1870627099165824/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969202 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969186.412286:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a46d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1870627099165824:0@lo:5: 00000004:00080000:2.0:1783969186.412303:0:9984:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1783969186.608776:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969187.185799:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099165952:0@lo:13: 00000100:00100000:2.0:1783969187.185871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969187.186015:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099165952 00000100:00100000:3.0:1783969187.186023:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099165952 00000100:00100000:3.0:1783969187.186093:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969187.186103:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099165952:12345-0@lo:13: 00002000:00000024:3.0:1783969187.186133:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969187.186198:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099165952:12345-0@lo:13: Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969187.186205:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969187.187030:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00080000:0.0:1783969187.187112:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779df80 x1870627099165952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969187.187132:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099165952:0@lo:13: 00000100:00100000:3.0:1783969187.194871:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099166080:0@lo:13: 00000100:00100000:3.0:1783969187.194953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969187.203727:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099166080 00000100:00100000:1.0:1783969187.203743:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099166080 00000100:00100000:1.0:1783969187.203824:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969187.203836:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099166080:12345-0@lo:13: 00002000:00000024:1.0:1783969187.203866:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969187.203962:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099166080:12345-0@lo:13: Request processed in 128us (9009us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969187.203969:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783969187.204254:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a47800 x1870627099166080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969187.204277:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099166080:0@lo:13: 00000001:00080000:2.0:1783969187.389870:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1783969187.632512:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783969188.358225:0:10042:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969188.358624:0:10042:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783969188.657625:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783969189.366946:0:10090:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969189.366957:0:10090:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1783969189.680904:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969190.056244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969190.056427:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073949824 00000100:00100000:0.0:1783969190.056436:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073949824 00000100:00100000:0.0:1783969190.056480:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:0.0:1783969190.056502:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2390:x1870627073949824:12345-192.168.201.34@tcp:250: 00010000:00080000:0.0:1783969190.056542:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bf66dfa7-835a-4dd9-abc8-2599d697b6ad@192.168.201.34@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1783969190.056567:0:6516:0:(genops.c:1406:class_connect()) connect: client bf66dfa7-835a-4dd9-abc8-2599d697b6ad, cookie 0xea31253a47cb9a8e 00000100:00080000:0.0:1783969190.056693:0:6516:0:(import.c:65:import_set_state_nolock()) ffff93eab72a0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969190.056765:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+5:2390:x1870627073949824:12345-192.168.201.34@tcp:250: Request processed in 262us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969190.056774:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:3.0:1783969190.061049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969190.061157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073949952 00000100:00100000:1.0:1783969190.061167:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073949952 00000100:00100000:1.0:1783969190.061224:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:1.0:1783969190.061233:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+5:6152:x1870627073949952:12345-192.168.201.34@tcp:101: 00010000:00010000:1.0:1783969190.061250:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969190.061270:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d35630369c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969190.061301:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630369c expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969190.061313:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630369c expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969190.061341:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b601400, rc 0) 00000100:00100000:1.0:1783969190.061430:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+6:6152:x1870627073949952:12345-192.168.201.34@tcp:101: Request processed in 198us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969190.061437:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:3.0:1783969190.069421:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969190.069567:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073950080 00000100:00100000:2.0:1783969190.069578:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073950080 00000100:00100000:2.0:1783969190.069648:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 183 00000100:00100000:2.0:1783969190.069659:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+6:6152:x1870627073950080:12345-192.168.201.34@tcp:501: 00000100:00100000:2.0:1783969190.069797:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+6:6152:x1870627073950080:12345-192.168.201.34@tcp:501: Request processed in 139us (429us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969190.069806:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 183 00000100:00100000:2.0:1783969190.082863:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969190.082973:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073950208 00000100:00100000:0.0:1783969190.082982:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073950208 00000100:00100000:0.0:1783969190.083039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 184 00000100:00100000:0.0:1783969190.083050:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+6:6152:x1870627073950208:12345-192.168.201.34@tcp:101: 00010000:00010000:0.0:1783969190.083066:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969190.083085:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d3563036a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969190.083121:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036a3 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969190.083133:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036a3 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969190.083144:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf200, rc 0) 00000100:00100000:0.0:1783969190.083246:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+7:6152:x1870627073950208:12345-192.168.201.34@tcp:101: Request processed in 197us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969190.083253:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 184 00000100:00100000:3.0:1783969190.089832:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969190.093820:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073950336 00000100:00100000:1.0:1783969190.093838:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073950336 00000100:00100000:1.0:1783969190.093934:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:1.0:1783969190.093945:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+7:6152:x1870627073950336:12345-192.168.201.34@tcp:501: 00000100:00100000:1.0:1783969190.094181:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:6152:x1870627073950336:12345-192.168.201.34@tcp:501: Request processed in 236us (4358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969190.094190:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:2.0:1783969190.097039:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969190.100612:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073950464 00000100:00100000:0.0:1783969190.100631:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073950464 00000100:00100000:0.0:1783969190.100736:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:0.0:1783969190.100747:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:6152:x1870627073950464:12345-192.168.201.34@tcp:503: 00000100:00100000:0.0:1783969190.100981:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:6152:x1870627073950464:12345-192.168.201.34@tcp:503: Request processed in 234us (3951us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969190.100989:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:2.0:1783969190.108472:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969190.109176:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073950592 00000100:00100000:0.0:1783969190.109189:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073950592 00000100:00100000:0.0:1783969190.109264:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:0.0:1783969190.109276:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:6170:x1870627073950592:12345-192.168.201.34@tcp:502: 00000100:00100000:0.0:1783969190.109534:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:6170:x1870627073950592:12345-192.168.201.34@tcp:502: Request processed in 261us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969190.109543:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:3.0:1783969190.179465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969190.179592:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073950720 00000100:00100000:1.0:1783969190.179609:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073950720 00000100:00100000:1.0:1783969190.179654:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:1.0:1783969190.179664:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:6170:x1870627073950720:12345-192.168.201.34@tcp:502: 00000100:00100000:1.0:1783969190.179828:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:6170:x1870627073950720:12345-192.168.201.34@tcp:502: Request processed in 164us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969190.179837:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:0.0:1783969190.197924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969190.199884:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073950848 00000100:00100000:2.0:1783969190.199898:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073950848 00000100:00100000:2.0:1783969190.199973:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:2.0:1783969190.199992:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:6152:x1870627073950848:12345-192.168.201.34@tcp:101: 00010000:00010000:2.0:1783969190.200014:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969190.200034:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad9800/0xea31253a47cb9aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d3563036d4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969190.200080:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad9800/0xea31253a47cb9aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036d4 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969190.200091:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad9800/0xea31253a47cb9aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036d4 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969190.200100:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9800, rc 0) 00000100:00100000:2.0:1783969190.200170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6152:x1870627073950848:12345-192.168.201.34@tcp:101: Request processed in 186us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969190.200178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:2.0:1783969190.215196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969190.216544:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073950976 00000100:00100000:0.0:1783969190.216567:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073950976 00000100:00100000:0.0:1783969190.216639:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:0.0:1783969190.216648:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6152:x1870627073950976:12345-192.168.201.34@tcp:256: 20000000:01000000:0.0:1783969190.217004:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783969190.217028:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783969190.217032:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783969190.217035:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783969190.217038:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783969190.217041:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1783969190.219958:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6152:x1870627073950976:12345-192.168.201.34@tcp:256: Request processed in 3291us (4753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969190.219977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:2.0:1783969190.223468:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969190.226286:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073951104 00000100:00100000:1.0:1783969190.226301:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073951104 00000100:00100000:1.0:1783969190.226434:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:1.0:1783969190.226445:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6152:x1870627073951104:12345-192.168.201.34@tcp:101: 00010000:00010000:1.0:1783969190.226464:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969190.226486:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d3563036db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969190.226562:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036db expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969190.226573:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036db expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969190.226582:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600800, rc 0) 00000100:00100000:1.0:1783969190.226680:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6152:x1870627073951104:12345-192.168.201.34@tcp:101: Request processed in 236us (3224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969190.226687:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:2.0:1783969190.230374:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969190.230545:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073951232 00000100:00100000:0.0:1783969190.230585:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073951232 00000100:00100000:0.0:1783969190.230662:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 192 00000100:00100000:0.0:1783969190.230673:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6152:x1870627073951232:12345-192.168.201.34@tcp:501: 00000100:00100000:0.0:1783969190.233972:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6152:x1870627073951232:12345-192.168.201.34@tcp:501: Request processed in 3274us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969190.233991:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 192 00000100:00100000:3.0:1783969190.237434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969190.237822:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073951360 00000100:00100000:2.0:1783969190.237835:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073951360 00000100:00100000:2.0:1783969190.238179:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:2.0:1783969190.238194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6152:x1870627073951360:12345-192.168.201.34@tcp:503: 00000100:00100000:2.0:1783969190.238598:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6152:x1870627073951360:12345-192.168.201.34@tcp:503: Request processed in 398us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969190.238612:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:2.0:1783969190.242465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969190.242548:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073951488 00000100:00100000:0.0:1783969190.242564:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073951488 00000100:00100000:0.0:1783969190.242794:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:0.0:1783969190.242808:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6176:x1870627073951488:12345-192.168.201.34@tcp:502: 00000100:00100000:0.0:1783969190.243024:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6176:x1870627073951488:12345-192.168.201.34@tcp:502: Request processed in 219us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969190.243032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:3.0:1783969190.245960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969190.246358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073951616 00000100:00100000:2.0:1783969190.246372:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073951616 00000100:00100000:2.0:1783969190.246476:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:2.0:1783969190.246489:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6176:x1870627073951616:12345-192.168.201.34@tcp:502: 00000100:00100000:2.0:1783969190.246775:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6176:x1870627073951616:12345-192.168.201.34@tcp:502: Request processed in 287us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969190.246791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:3.0:1783969190.252461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969190.252551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969190.252798:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073951744 00000100:00100000:1.0:1783969190.252809:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073951744 00000100:00100000:1.0:1783969190.252857:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073952000 00000100:00100000:1.0:1783969190.252860:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073952000 00000100:00100000:1.0:1783969190.252887:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1783969190.252898:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1870627073951744:12345-192.168.201.34@tcp:38: 00010000:00080000:1.0:1783969190.252930:0:6521:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1783969190.252980:0:6521:0:(genops.c:1406:class_connect()) connect: client c481ab09-d97e-4adb-b42e-68f98b038d20, cookie 0xea31253a47cb9ab1 00000004:00100000:1.0:1783969190.253007:0:6521:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783969190.253233:0:6521:0:(import.c:65:import_set_state_nolock()) ffff93e9835ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969190.253314:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2390:x1870627073951744:12345-192.168.201.34@tcp:38: Request processed in 416us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969190.253323:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1783969190.253342:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1783969190.253346:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1870627073952000:12345-192.168.201.34@tcp:38: 00010000:00080000:1.0:1783969190.253422:0:6521:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1783969190.253468:0:6521:0:(genops.c:1406:class_connect()) connect: client c481ab09-d97e-4adb-b42e-68f98b038d20, cookie 0xea31253a47cb9ab8 00000004:00100000:1.0:1783969190.253480:0:6521:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783969190.254741:0:6521:0:(import.c:65:import_set_state_nolock()) ffff93e9835e9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969190.254790:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2390:x1870627073952000:12345-192.168.201.34@tcp:38: Request processed in 1442us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969190.254799:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00010000:00010000:2.0:1783969190.704670:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969190.770736:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969190.770777:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099166208:0@lo:41: 00000100:00100000:1.0:1783969190.771334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969190.771666:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099166208 00000100:00100000:0.0:1783969190.771676:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099166208 00000100:00100000:0.0:1783969190.771734:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783969190.771745:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099166208:12345-0@lo:41: 00000004:00000024:0.0:1783969190.771793:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783969190.771903:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099166208:12345-0@lo:41: Request processed in 159us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969190.771912:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783969190.772167:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099166208:0@lo:41: 00000100:00100000:0.0:1783969191.280213:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969191.280321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969191.280612:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073951872 00000100:00100000:3.0:1783969191.280622:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073951872 00000100:00100000:3.0:1783969191.280689:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073952128 00000100:00100000:3.0:1783969191.280693:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073952128 00000100:00100000:3.0:1783969191.280717:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1783969191.280728:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:0:x1870627073951872:12345-192.168.201.34@tcp:41: 00000004:00000024:3.0:1783969191.280780:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783969191.280844:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:0:x1870627073951872:12345-192.168.201.34@tcp:41: Request processed in 117us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969191.280851:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1783969191.280868:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1783969191.280876:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:0:x1870627073952128:12345-192.168.201.34@tcp:41: 00000004:00000024:3.0:1783969191.280892:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783969191.280942:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:0:x1870627073952128:12345-192.168.201.34@tcp:41: Request processed in 66us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969191.280949:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00080000:2.0:1783969191.280994:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969191.280999:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969191.281262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969191.281439:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073952256 00000100:00100000:2.0:1783969191.281443:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073952256 00000100:00100000:2.0:1783969191.281468:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1783969191.281474:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6152:x1870627073952256:12345-192.168.201.34@tcp:41: 00000004:00000024:2.0:1783969191.281497:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783969191.281718:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6152:x1870627073952256:12345-192.168.201.34@tcp:41: Request processed in 242us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.281726:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1783969191.281886:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969191.281901:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099166336:0@lo:41: 00000100:00100000:3.0:1783969191.281943:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969191.282002:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099166336 00000100:00100000:3.0:1783969191.282006:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099166336 00000100:00100000:3.0:1783969191.282035:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783969191.282041:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099166336:12345-0@lo:41: 00000004:00000024:3.0:1783969191.282055:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783969191.282088:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099166336:12345-0@lo:41: Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969191.282095:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783969191.282131:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099166336:0@lo:41: 00000100:00100000:0.0:1783969191.298984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969191.299110:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073952384 00000100:00100000:2.0:1783969191.299119:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073952384 00000100:00100000:2.0:1783969191.299222:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1783969191.299233:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6152:x1870627073952384:12345-192.168.201.34@tcp:40: 00000100:00100000:2.0:1783969191.299325:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6152:x1870627073952384:12345-192.168.201.34@tcp:40: Request processed in 94us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.299332:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1783969191.303343:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969191.303432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969191.303570:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073952512 00000100:00100000:2.0:1783969191.303579:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073952512 00000100:00100000:2.0:1783969191.303629:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073952640 00000100:00100000:2.0:1783969191.303632:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073952640 00000100:00100000:2.0:1783969191.303667:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1783969191.303675:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1870627073952512:12345-192.168.201.34@tcp:8: 00010000:00080000:2.0:1783969191.303709:0:9974:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1783969191.303750:0:9974:0:(genops.c:1406:class_connect()) connect: client c481ab09-d97e-4adb-b42e-68f98b038d20, cookie 0xea31253a47cb9abf 00002000:00100000:2.0:1783969191.303763:0:9974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c481ab09-d97e-4adb-b42e-68f98b038d20/ffff93eab9fc3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969191.303780:0:9974:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783969191.304016:0:9974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783969191.304046:0:9974:0:(import.c:65:import_set_state_nolock()) ffff93eab9fc4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969191.304112:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2390:x1870627073952512:12345-192.168.201.34@tcp:8: Request processed in 436us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.304121:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1783969191.304141:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:2.0:1783969191.304146:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1870627073952640:12345-192.168.201.34@tcp:8: 00010000:00080000:2.0:1783969191.304178:0:9974:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1783969191.304196:0:9974:0:(genops.c:1406:class_connect()) connect: client c481ab09-d97e-4adb-b42e-68f98b038d20, cookie 0xea31253a47cb9ac6 00002000:00100000:2.0:1783969191.304202:0:9974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c481ab09-d97e-4adb-b42e-68f98b038d20/ffff93eab9ee0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969191.304213:0:9974:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783969191.304311:0:9974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783969191.304326:0:9974:0:(import.c:65:import_set_state_nolock()) ffff93eaac722800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969191.304348:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2390:x1870627073952640:12345-192.168.201.34@tcp:8: Request processed in 201us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.304354:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1783969191.307528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969191.308094:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073952768 00000100:00100000:2.0:1783969191.308104:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073952768 00000100:00100000:2.0:1783969191.308164:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:2.0:1783969191.308175:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6152:x1870627073952768:12345-192.168.201.34@tcp:900: 00000100:00100000:2.0:1783969191.308253:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6152:x1870627073952768:12345-192.168.201.34@tcp:900: Request processed in 80us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.308271:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:2.0:1783969191.311883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969191.311973:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073953024 00000100:00100000:3.0:1783969191.311983:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073953024 00000100:00100000:3.0:1783969191.312037:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1783969191.312047:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6152:x1870627073953024:12345-192.168.201.34@tcp:33: 00000100:00100000:3.0:1783969191.314581:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969191.314679:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073952896 00000100:00100000:2.0:1783969191.314687:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073952896 00000100:00100000:2.0:1783969191.314737:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:2.0:1783969191.314748:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073952896:12345-192.168.201.34@tcp:400: 00000100:00100000:2.0:1783969191.314826:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073952896:12345-192.168.201.34@tcp:400: Request processed in 79us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.314834:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 196 00000004:00080000:3.0:1783969191.345850:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33698us 00000004:00200000:3.0:1783969191.401214:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783969191.401337:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6152:x1870627073953024:12345-192.168.201.34@tcp:33: Request processed in 89285us (89457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969191.401349:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00010000:00010000:3.0:1783969191.729229:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969191.752902:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969191.753059:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073953152 00000100:00100000:1.0:1783969191.753072:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073953152 00000100:00100000:1.0:1783969191.753178:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1783969191.753194:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6194:x1870627073953152:12345-192.168.201.34@tcp:101: 00010000:00010000:1.0:1783969191.753226:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969191.753265:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9acd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630370c expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969191.753366:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9ad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969191.753439:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969191.753457:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969191.753535:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783969191.753555:0:7749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969191.753593:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969191.753626:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9acd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630370c expref: 8 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969191.753649:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630370c expref: 7 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969191.753660:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253f00) 00010000:00010000:1.0:1783969191.753664:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969191.753873:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b601600, rc 0) 00000100:00100000:1.0:1783969191.753957:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:6194:x1870627073953152:12345-192.168.201.34@tcp:101: Request processed in 767us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969191.753965:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1783969191.792718:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099166848:0@lo:400: 00000100:00100000:1.0:1783969191.792829:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969191.792917:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099167360:0@lo:400: 00000100:00100000:1.0:1783969191.792954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969191.792987:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099167872:0@lo:400: 00000100:00100000:1.0:1783969191.793024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969191.793058:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1783969191.793071:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099166464:0@lo:13: 00000100:00100000:2.0:1783969191.793073:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099166720:0@lo:400: 00000100:00100000:2.0:1783969191.793148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969191.793182:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099167232:0@lo:400: 00000100:00100000:2.0:1783969191.793203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969191.793219:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099167744:0@lo:400: 00000100:00100000:2.0:1783969191.793253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969191.793280:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783969191.793287:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099166592:0@lo:400: 00000100:00100000:2.0:1783969191.793312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969191.793332:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099167104:0@lo:400: 00000100:00100000:2.0:1783969191.793348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969191.793360:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099167616:0@lo:400: 00000100:00100000:2.0:1783969191.793408:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969191.793440:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099166720 00000100:00100000:2.0:1783969191.793446:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099166720 00000100:00100000:2.0:1783969191.793497:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099167232 00000100:00100000:2.0:1783969191.793509:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099167232 00000100:00100000:2.0:1783969191.793535:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099167744 00000100:00100000:2.0:1783969191.793537:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099167744 00000100:00100000:2.0:1783969191.793547:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099167104 00000100:00100000:2.0:1783969191.793549:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099167104 00000100:00100000:2.0:1783969191.793561:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099167616 00000100:00100000:2.0:1783969191.793563:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099167616 00000100:00100000:2.0:1783969191.793578:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783969191.793586:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099166720:12345-0@lo:400: 00000100:00100000:2.0:1783969191.793637:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099166720:12345-0@lo:400: Request processed in 51us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.793644:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783969191.793663:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783969191.793669:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099167232:12345-0@lo:400: 00000100:00100000:2.0:1783969191.793696:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099167232:12345-0@lo:400: Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.793702:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783969191.793720:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783969191.793726:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099167744:12345-0@lo:400: 00000100:00100000:2.0:1783969191.793792:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099167744:12345-0@lo:400: Request processed in 65us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.793798:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783969191.793812:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969191.793819:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099167104:12345-0@lo:400: 00000100:00100000:2.0:1783969191.793846:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099167104:12345-0@lo:400: Request processed in 28us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.793853:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969191.793865:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783969191.793877:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099167616:12345-0@lo:400: 00000100:00100000:2.0:1783969191.793904:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099167616:12345-0@lo:400: Request processed in 28us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.793909:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1783969191.793932:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969191.793937:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969191.793974:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099167104:0@lo:400: 00000100:00100000:2.0:1783969191.793988:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099167616:0@lo:400: 00000100:00100000:2.0:1783969191.794014:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099166720:0@lo:400: 00010000:00080000:2.0:1783969191.794027:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319c000 x1870627099167232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969191.794038:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099167232:0@lo:400: 00010000:00080000:2.0:1783969191.794047:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319d880 x1870627099167744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969191.794056:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099167744:0@lo:400: 00000100:00100000:2.0:1783969191.794132:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099166848 00000100:00100000:2.0:1783969191.794136:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099166848 00000100:00100000:2.0:1783969191.794162:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783969191.794167:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099166848:12345-0@lo:400: 00000100:00100000:2.0:1783969191.794201:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099166848:12345-0@lo:400: Request processed in 34us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.794206:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783969191.794250:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099167360 00000100:00100000:2.0:1783969191.794254:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099167360 00000100:00100000:2.0:1783969191.794282:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099167872 00000100:00100000:2.0:1783969191.794290:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099167872 00000100:00100000:2.0:1783969191.794309:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969191.794315:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099167360:12345-0@lo:400: 00000100:00100000:2.0:1783969191.794349:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099167360:12345-0@lo:400: Request processed in 34us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.794355:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969191.794367:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969191.794373:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099167872:12345-0@lo:400: 00000100:00100000:2.0:1783969191.794430:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099167872:12345-0@lo:400: Request processed in 57us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.794436:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1783969191.794450:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969191.794452:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969191.794600:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099166592 00000100:00100000:0.0:1783969191.794611:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099166592 00000100:00100000:0.0:1783969191.794646:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783969191.794653:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099166592:12345-0@lo:400: 00000100:00100000:0.0:1783969191.794693:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099166592:12345-0@lo:400: Request processed in 41us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969191.794699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783969191.794734:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099166592:0@lo:400: 00000100:00100000:0.0:1783969191.795623:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099168128:0@lo:13: 00000100:00100000:0.0:1783969191.796354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969191.798760:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099168128 00000100:00100000:2.0:1783969191.798777:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099168128 00000100:00100000:2.0:1783969191.798856:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783969191.798867:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099168128:12345-0@lo:13: 00002000:00000024:2.0:1783969191.798898:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969191.801964:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969191.802058:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099166976:0@lo:400: 00000100:00100000:1.0:1783969191.802116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969191.803319:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099166976 00000100:00100000:1.0:1783969191.803328:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099166976 00000100:00100000:1.0:1783969191.803990:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783969191.804000:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099166976:12345-0@lo:400: 00000100:00100000:1.0:1783969191.804072:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099166976:12345-0@lo:400: Request processed in 73us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969191.804080:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783969191.805789:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099166976:0@lo:400: 00000100:00100000:1.0:1783969191.805808:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099167488:0@lo:400: 00000100:00100000:1.0:1783969191.805874:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969191.805925:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099167488 00000100:00100000:1.0:1783969191.805931:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099167488 00000100:00100000:1.0:1783969191.805989:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783969191.805996:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099167488:12345-0@lo:400: 00000100:00100000:3.0:1783969191.806035:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1783969191.806048:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1783969191.806048:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099167488:12345-0@lo:400: Request processed in 51us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969191.806057:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1783969191.806083:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783969191.806111:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319fb80 x1870627099167488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969191.806123:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099167488:0@lo:400: 00000100:00100000:3.0:1783969191.806159:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099166464 00000100:00100000:3.0:1783969191.806164:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099166464 00000100:00100000:3.0:1783969191.806316:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969191.806324:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099166464:12345-0@lo:13: 00002000:00000024:3.0:1783969191.806341:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969191.806378:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099166464:12345-0@lo:13: Request processed in 54us (4423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969191.806404:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1783969191.807912:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969191.807930:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099168000:0@lo:400: 00000100:00100000:1.0:1783969191.807984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783969191.808034:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319f480 x1870627099167360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969191.808064:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099167360:0@lo:400: 00010000:00080000:1.0:1783969191.808090:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319ed80 x1870627099167872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969191.808098:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783969191.808112:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099167872:0@lo:400: 00000100:00100000:3.0:1783969191.808372:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099168000 00000100:00100000:3.0:1783969191.808394:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099168000 00000100:00100000:3.0:1783969191.808437:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969191.808446:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099168000:12345-0@lo:400: 00000100:00100000:3.0:1783969191.808509:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099168000:12345-0@lo:400: Request processed in 64us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969191.808517:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969191.809242:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099166848:0@lo:400: 00010000:00080000:1.0:1783969191.809287:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319c700 x1870627099166464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969191.809296:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1783969191.809313:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099166464:0@lo:13: 00010000:00080000:1.0:1783969191.809325:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319ca80 x1870627099168000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969191.809333:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099168000:0@lo:400: 00000100:00100000:2.0:1783969191.817100:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099168128:12345-0@lo:13: Request processed in 18223us (20735us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969191.817116:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1783969191.830040:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983490a80 x1870627099168128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969191.830082:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099168128:0@lo:13: 00000100:00100000:1.0:1783969192.304768:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099168256:0@lo:13: 00000100:00100000:1.0:1783969192.304842:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969192.304979:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099168384:0@lo:13: 00000100:00100000:1.0:1783969192.305005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969192.305162:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099168256 00000100:00100000:3.0:1783969192.305170:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099168256 00000100:00100000:3.0:1783969192.305237:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099168384 00000100:00100000:3.0:1783969192.305241:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099168384 00000100:00100000:3.0:1783969192.305260:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969192.305269:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099168256:12345-0@lo:13: 00002000:00000024:3.0:1783969192.305295:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969192.305342:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099168256:12345-0@lo:13: Request processed in 73us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969192.305350:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969192.305367:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969192.305375:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099168384:12345-0@lo:13: 00002000:00000024:3.0:1783969192.305400:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969192.305443:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099168384:12345-0@lo:13: Request processed in 68us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969192.305449:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1783969192.305802:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a47800 x1870627099168384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969192.305822:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099168384:0@lo:13: 00010000:00080000:1.0:1783969192.306129:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7415f80 x1870627099168256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969192.306143:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099168256:0@lo:13: 00010000:00010000:3.0:1783969192.755663:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969193.776872:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969194.312097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969194.312230:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073953280 00000100:00100000:0.0:1783969194.312244:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073953280 00000100:00100000:0.0:1783969194.312350:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1783969194.312365:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:6246:x1870627073953280:12345-192.168.201.34@tcp:41: 00000004:00000024:0.0:1783969194.312472:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783969194.312571:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:6246:x1870627073953280:12345-192.168.201.34@tcp:41: Request processed in 209us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969194.312580:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00080000:1.0:1783969194.313261:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969194.315899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969194.317315:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073953408 00000100:00100000:0.0:1783969194.317334:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073953408 00000100:00100000:0.0:1783969194.317475:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1783969194.317489:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6246:x1870627073953408:12345-192.168.201.34@tcp:41: 00000004:00000024:0.0:1783969194.317636:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783969194.317755:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6246:x1870627073953408:12345-192.168.201.34@tcp:41: Request processed in 270us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969194.317764:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00080000:1.0:1783969194.317856:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969194.321701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969194.321883:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073953536 00000100:00100000:2.0:1783969194.321915:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073953536 00000100:00100000:2.0:1783969194.322006:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1783969194.322019:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6246:x1870627073953536:12345-192.168.201.34@tcp:13: 00002000:00000024:2.0:1783969194.322069:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969194.322170:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6246:x1870627073953536:12345-192.168.201.34@tcp:13: Request processed in 153us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969194.322179:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00080000:1.0:1783969194.322655:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969194.328741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969194.329013:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073953664 00000100:00100000:1.0:1783969194.329027:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073953664 00000100:00100000:1.0:1783969194.329122:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1783969194.329136:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6246:x1870627073953664:12345-192.168.201.34@tcp:13: 00002000:00000024:1.0:1783969194.329190:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969194.329293:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c481ab09-d97e-4adb-b42e-68f98b038d20+6:6246:x1870627073953664:12345-192.168.201.34@tcp:13: Request processed in 153us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969194.329301:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00080000:2.0:1783969194.330421:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783969194.802044:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783969194.870603:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00010000:00010000:3.0:1783969195.827178:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969195.889213:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099168512:0@lo:41: 00000100:00100000:3.0:1783969195.889291:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969195.889511:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099168512 00000100:00100000:2.0:1783969195.889520:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099168512 00000100:00100000:2.0:1783969195.889582:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969195.889593:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099168512:12345-0@lo:41: 00000004:00000024:2.0:1783969195.889627:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783969195.889677:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099168512:12345-0@lo:41: Request processed in 86us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969195.889684:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783969195.890250:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099168512:0@lo:41: 00000001:00100000:3.0:1783969195.911024:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000001:00100000:1.0:1783969195.912795:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000100:00100000:1.0:1783969196.401763:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969196.401788:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099168640:0@lo:41: 00000100:00100000:1.0:1783969196.401863:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969196.401979:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099168640 00000100:00100000:3.0:1783969196.401988:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099168640 00000100:00100000:3.0:1783969196.402049:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783969196.402059:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099168640:12345-0@lo:41: 00000004:00000024:3.0:1783969196.402092:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783969196.402146:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099168640:12345-0@lo:41: Request processed in 88us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969196.402153:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783969196.402333:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099168640:0@lo:41: 00000100:00100000:0.0:1783969196.811931:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969196.811971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969196.812008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969196.812034:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969196.812059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969196.812090:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073954048 00000100:00100000:0.0:1783969196.812111:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073954048 00000100:00100000:0.0:1783969196.812176:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073953920 00000100:00100000:0.0:1783969196.812178:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073953920 00000100:00100000:0.0:1783969196.812202:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1783969196.812213:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954048:12345-192.168.201.34@tcp:400: 00000100:00100000:0.0:1783969196.812299:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954048:12345-192.168.201.34@tcp:400: Request processed in 89us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969196.812308:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1783969196.812326:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:0.0:1783969196.812332:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2394:x1870627073953920:12345-192.168.201.34@tcp:400: 00000100:00100000:0.0:1783969196.812353:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2394:x1870627073953920:12345-192.168.201.34@tcp:400: Request processed in 21us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969196.812359:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00080000:2.0:1783969196.812677:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969196.812683:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969196.812780:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073954304 00000100:00100000:3.0:1783969196.812786:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073954304 00000100:00100000:3.0:1783969196.812834:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073954176 00000100:00100000:3.0:1783969196.812837:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073954176 00000100:00100000:3.0:1783969196.812859:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1783969196.812867:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954304:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1783969196.812898:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954304:12345-192.168.201.34@tcp:400: Request processed in 33us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969196.812905:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1783969196.812915:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1783969196.812920:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2394:x1870627073954176:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1783969196.812940:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2394:x1870627073954176:12345-192.168.201.34@tcp:400: Request processed in 20us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969196.812946:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00080000:2.0:1783969196.813167:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969196.813172:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969196.816317:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073953792 00000100:00100000:1.0:1783969196.816331:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073953792 00000100:00100000:1.0:1783969196.816460:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:1.0:1783969196.816471:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2394:x1870627073953792:12345-192.168.201.34@tcp:400: 00000100:00100000:1.0:1783969196.816572:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2394:x1870627073953792:12345-192.168.201.34@tcp:400: Request processed in 102us (4654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969196.816580:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 198 00010000:00010000:2.0:1783969196.848609:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969196.912830:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969196.912871:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099168768:0@lo:13: 00000100:00100000:0.0:1783969196.912957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969196.913236:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099168768 00000100:00100000:3.0:1783969196.913246:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099168768 00000100:00100000:3.0:1783969196.913322:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783969196.913333:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099168768:12345-0@lo:13: 00002000:00000024:3.0:1783969196.913369:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969196.913459:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099168768:12345-0@lo:13: Request processed in 128us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969196.913492:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1783969196.913549:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983491500 x1870627099168768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969196.913579:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099168768:0@lo:13: 00000100:00100000:2.0:1783969196.913848:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099168896:0@lo:13: 00000100:00100000:2.0:1783969196.913882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1783969196.916579:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000100:00080000:0.0:1783969196.917208:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969196.922161:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099168896 00000100:00100000:3.0:1783969196.922180:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099168896 00000100:00100000:3.0:1783969196.923248:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969196.923265:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099168896:12345-0@lo:13: 00002000:00000024:3.0:1783969196.923304:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969196.923922:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099169024:0@lo:400: 00000100:00100000:2.0:1783969196.924031:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099169152:0@lo:400: 00000100:00100000:1.0:1783969196.924276:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969196.924355:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099169024 00000100:00100000:1.0:1783969196.924362:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099169024 00000100:00100000:1.0:1783969196.924563:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783969196.924571:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099169024:12345-0@lo:400: 00000100:00100000:1.0:1783969196.924622:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099169024:12345-0@lo:400: Request processed in 51us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969196.924629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783969196.924679:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099169024:0@lo:400: 00000100:00100000:1.0:1783969196.924729:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099169280:0@lo:400: 00000100:00100000:2.0:1783969196.924966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969196.925000:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099169152 00000100:00100000:2.0:1783969196.925004:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099169152 00000100:00100000:2.0:1783969196.925034:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783969196.925047:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099169152:12345-0@lo:400: 00000100:00100000:2.0:1783969196.925087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099169152:12345-0@lo:400: Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969196.925094:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783969196.925126:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099169152:0@lo:400: 00000100:00100000:1.0:1783969196.926707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969196.926859:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099169280 00000100:00100000:2.0:1783969196.926865:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099169280 00000100:00100000:2.0:1783969196.926907:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783969196.926915:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099169280:12345-0@lo:400: 00000100:00100000:3.0:1783969196.927549:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099168896:12345-0@lo:13: Request processed in 4280us (13656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969196.927616:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1783969196.927691:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e2a00 x1870627099168896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969196.927718:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099168896:0@lo:13: 00000100:00100000:1.0:1783969196.928310:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969196.928323:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099169408:0@lo:400: 00000100:00100000:1.0:1783969196.928353:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969196.945868:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099169280:12345-0@lo:400: Request processed in 18941us (19153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969196.945883:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783969196.955442:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099169280:0@lo:400: 00000100:00100000:1.0:1783969196.960633:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969196.960660:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099169536:0@lo:400: 00000100:00100000:1.0:1783969196.960725:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969196.960779:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099169536 00000100:00100000:1.0:1783969196.960791:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969196.960794:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099169536 00000100:00100000:1.0:1783969196.960805:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099169664:0@lo:400: 00000100:00100000:1.0:1783969196.960846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969196.960876:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783969196.960899:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099169536:12345-0@lo:400: 00000100:00100000:3.0:1783969196.961008:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099169536:12345-0@lo:400: Request processed in 122us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969196.961015:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783969196.967627:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099169536:0@lo:400: 00000100:00100000:1.0:1783969196.967713:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099169792:0@lo:400: 00000100:00100000:1.0:1783969196.967764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783969196.971520:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969196.971841:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099170176:0@lo:400: 00000100:00100000:0.0:1783969196.971936:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099169920:0@lo:400: 00000100:00100000:0.0:1783969196.971974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969196.972029:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969196.972036:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099170048:0@lo:400: 00000100:00100000:0.0:1783969196.972060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969196.972100:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099169920 00000100:00100000:0.0:1783969196.972109:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099169920 00000100:00100000:0.0:1783969196.972168:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099170048 00000100:00100000:0.0:1783969196.972171:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099170048 00000100:00100000:0.0:1783969196.972197:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969196.972207:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099169920:12345-0@lo:400: 00000100:00100000:0.0:1783969196.972266:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099169920:12345-0@lo:400: Request processed in 59us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969196.972275:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969196.972293:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969196.972299:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099170048:12345-0@lo:400: 00000100:00100000:0.0:1783969196.972325:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099170048:12345-0@lo:400: Request processed in 25us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969196.972331:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1783969196.972425:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7415f80 x1870627099170048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969196.972443:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099170048:0@lo:400: 00010000:00080000:0.0:1783969196.972459:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7414000 x1870627099169920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969196.972468:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099169920:0@lo:400: 00000100:00100000:2.0:1783969196.972477:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099169408 00000100:00100000:2.0:1783969196.972493:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099169408 00000100:00080000:0.0:1783969196.972517:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969196.972575:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099169664 00000100:00100000:2.0:1783969196.972580:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099169664 00000100:00100000:2.0:1783969196.972634:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969196.972644:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099169408:12345-0@lo:400: 00000100:00100000:2.0:1783969196.972740:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099169408:12345-0@lo:400: Request processed in 97us (44384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969196.972748:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969196.972768:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783969196.972774:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099169664:12345-0@lo:400: 00000100:00100000:2.0:1783969196.972803:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099169664:12345-0@lo:400: Request processed in 30us (11957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969196.972810:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783969196.972871:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099169408:0@lo:400: 00000100:00100000:1.0:1783969196.973299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969196.973343:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969196.973354:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099170304:0@lo:400: 00000100:00100000:1.0:1783969196.973421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969196.973453:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099169664:0@lo:400: 00000100:00100000:3.0:1783969196.973543:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099169792 00000100:00100000:3.0:1783969196.973548:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099169792 00000100:00100000:3.0:1783969196.973593:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099170176 00000100:00100000:3.0:1783969196.973597:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099170176 00000100:00100000:3.0:1783969196.973611:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099170304 00000100:00100000:3.0:1783969196.973613:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099170304 00000100:00100000:3.0:1783969196.973625:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783969196.973631:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099169792:12345-0@lo:400: 00000100:00100000:3.0:1783969196.973669:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099169792:12345-0@lo:400: Request processed in 37us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969196.973675:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783969196.973688:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783969196.973693:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099170176:12345-0@lo:400: 00000100:00100000:3.0:1783969196.973722:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099170176:12345-0@lo:400: Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969196.973729:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783969196.973739:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783969196.973745:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099170304:12345-0@lo:400: 00000100:00100000:3.0:1783969196.973771:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099170304:12345-0@lo:400: Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969196.973776:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1783969196.974126:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e7b80 x1870627099170304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969196.974137:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099170304:0@lo:400: 00000100:00100000:1.0:1783969196.974156:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099170176:0@lo:400: 00010000:00080000:1.0:1783969196.974182:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734f100 x1870627099169792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969196.974190:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099169792:0@lo:400: 00000100:00080000:0.0:1783969196.974271:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969196.974276:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969197.430272:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099170432:0@lo:13: 00000100:00100000:2.0:1783969197.430370:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969197.430783:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099170432 00000100:00100000:0.0:1783969197.430795:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099170432 00000100:00100000:0.0:1783969197.430861:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783969197.430872:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099170432:12345-0@lo:13: 00002000:00000024:0.0:1783969197.430921:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969197.430986:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099170432:12345-0@lo:13: Request processed in 115us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969197.430994:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1783969197.431455:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e4380 x1870627099170432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969197.431478:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099170432:0@lo:13: 00000100:00100000:3.0:1783969197.450706:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099170560:0@lo:13: 00000100:00100000:3.0:1783969197.450804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969197.451352:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099170560 00000100:00100000:0.0:1783969197.451364:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099170560 00000100:00100000:0.0:1783969197.451467:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783969197.451479:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099170560:12345-0@lo:13: 00002000:00000024:0.0:1783969197.451512:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969197.451595:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099170560:12345-0@lo:13: Request processed in 118us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969197.451604:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1783969197.454590:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e4700 x1870627099170560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969197.454628:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099170560:0@lo:13: 00010000:00010000:3.0:1783969197.876595:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783969198.196406:0:10189:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1783969198.896648:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969199.923281:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969200.944885:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969201.013662:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099170688:0@lo:41: 00000100:00100000:3.0:1783969201.014176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969201.015006:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099170688 00000100:00100000:0.0:1783969201.015021:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099170688 00000100:00100000:0.0:1783969201.015091:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783969201.015102:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099170688:12345-0@lo:41: 00000004:00000024:0.0:1783969201.015149:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783969201.015281:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099170688:12345-0@lo:41: Request processed in 181us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969201.015287:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783969201.015406:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099170688:0@lo:41: 00000100:00100000:2.0:1783969201.521781:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969201.521838:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099170816:0@lo:41: 00000100:00100000:2.0:1783969201.521944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969201.522135:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099170816 00000100:00100000:1.0:1783969201.522150:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099170816 00000100:00100000:1.0:1783969201.522232:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783969201.522246:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099170816:12345-0@lo:41: 00000004:00000024:1.0:1783969201.522301:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969201.522374:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099170816:12345-0@lo:41: Request processed in 131us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969201.522418:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783969201.523757:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099170816:0@lo:41: 00000100:00100000:0.0:1783969201.932561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969201.932628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969201.932831:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073954560 00000100:00100000:3.0:1783969201.932845:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073954560 00000100:00100000:2.0:1783969201.932888:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073954432 00000100:00100000:2.0:1783969201.932893:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073954432 00000100:00100000:2.0:1783969201.932974:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:2.0:1783969201.932988:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2393:x1870627073954432:12345-192.168.201.34@tcp:400: 00000100:00100000:2.0:1783969201.933100:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2393:x1870627073954432:12345-192.168.201.34@tcp:400: Request processed in 115us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969201.933109:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:3.0:1783969201.933962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969201.934004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969201.934033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969201.934096:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073954816 00000100:00100000:2.0:1783969201.934104:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073954816 00000100:00100000:0.0:1783969201.934124:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073954944 00000100:00100000:0.0:1783969201.934129:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073954944 00000100:00100000:2.0:1783969201.934184:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1783969201.934193:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954816:12345-192.168.201.34@tcp:400: 00000100:00100000:2.0:1783969201.935032:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954816:12345-192.168.201.34@tcp:400: Request processed in 835us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969201.935044:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1783969201.947057:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073954688 00000100:00100000:2.0:1783969201.947081:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073954688 00000100:00100000:0.0:1783969201.951478:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1783969201.951507:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954944:12345-192.168.201.34@tcp:400: 00000100:00100000:0.0:1783969201.951650:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954944:12345-192.168.201.34@tcp:400: Request processed in 157us (17614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969201.951670:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1783969201.963772:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:0.0:1783969201.963797:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627073954560:12345-192.168.201.34@tcp:400: 00000100:00100000:0.0:1783969201.963943:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627073954560:12345-192.168.201.34@tcp:400: Request processed in 153us (31313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969201.963951:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00080000:1.0:1783969201.965724:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969201.965921:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969201.965926:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969201.965929:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969201.977262:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:2.0:1783969201.977287:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954688:12345-192.168.201.34@tcp:400: 00000100:00100000:2.0:1783969201.977503:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073954688:12345-192.168.201.34@tcp:400: Request processed in 224us (43495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969201.977514:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00010000:00010000:2.0:1783969201.977605:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969202.033082:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099171328:0@lo:400: 00000100:00100000:2.0:1783969202.033224:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099171200:0@lo:400: 00000100:00100000:2.0:1783969202.033298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969202.033631:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099170944:0@lo:400: 00000100:00100000:2.0:1783969202.033879:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099171712:0@lo:400: 00000100:00100000:2.0:1783969202.033927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969202.033966:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099172224:0@lo:400: 00000100:00100000:2.0:1783969202.033992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969202.034056:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099171200 00000100:00100000:2.0:1783969202.034067:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099171200 00000100:00100000:0.0:1783969202.034251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969202.034282:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783969202.034284:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099171840:0@lo:400: 00000100:00100000:2.0:1783969202.034296:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099171200:12345-0@lo:400: 00000100:00100000:0.0:1783969202.034324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969202.034344:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099172352:0@lo:400: 00000100:00100000:0.0:1783969202.034366:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969202.038794:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099171200:12345-0@lo:400: Request processed in 4478us (5474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969202.038819:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783969202.038966:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099171712 00000100:00100000:2.0:1783969202.038977:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099171712 00000100:00100000:2.0:1783969202.039058:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099172224 00000100:00100000:2.0:1783969202.039062:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099172224 00000100:00100000:2.0:1783969202.039090:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099171328 00000100:00100000:2.0:1783969202.039094:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099171328 00000100:00100000:2.0:1783969202.039115:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783969202.040009:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099171712:12345-0@lo:400: 00000100:00100000:3.0:1783969202.040711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969202.040790:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099171456:0@lo:400: 00000100:00100000:3.0:1783969202.040852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969202.040880:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099171968:0@lo:400: 00000100:00100000:1.0:1783969202.040895:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783969202.040911:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099172224:12345-0@lo:400: 00000100:00100000:3.0:1783969202.040912:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969202.040942:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099172480:0@lo:400: 00000100:00100000:1.0:1783969202.040974:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099172224:12345-0@lo:400: Request processed in 68us (6980us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.040982:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783969202.041001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969202.041021:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783969202.041029:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099171328:12345-0@lo:400: 00000100:00100000:3.0:1783969202.041039:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1783969202.041051:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099171072:0@lo:400: 00000100:00100000:1.0:1783969202.041073:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099171328:12345-0@lo:400: Request processed in 44us (6821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.041080:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783969202.041091:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969202.041106:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099170944 00000100:00100000:1.0:1783969202.041113:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099170944 00000100:00100000:1.0:1783969202.041167:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783969202.041174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099170944:12345-0@lo:400: 00000100:00100000:1.0:1783969202.041207:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099170944:12345-0@lo:400: Request processed in 34us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.041213:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783969202.041243:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099171072 00000100:00100000:1.0:1783969202.041247:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099171072 00000100:00100000:1.0:1783969202.041262:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783969202.041266:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099171072:12345-0@lo:400: 00000100:00100000:3.0:1783969202.041284:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099171584:0@lo:400: 00000100:00100000:1.0:1783969202.041294:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099171072:12345-0@lo:400: Request processed in 25us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.041300:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1783969202.041327:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969202.041340:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969202.041369:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099172096:0@lo:400: 00000100:00100000:1.0:1783969202.041369:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099171840 00000100:00100000:1.0:1783969202.041375:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099171840 00000100:00100000:3.0:1783969202.041421:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969202.041438:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099172608:0@lo:13: 00000100:00100000:1.0:1783969202.041447:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099172352 00000100:00100000:1.0:1783969202.041453:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099172352 00000100:00100000:3.0:1783969202.041464:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969202.041472:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099171968 00000100:00100000:3.0:1783969202.041523:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099170944:0@lo:400: 00000100:00100000:3.0:1783969202.041554:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099171072:0@lo:400: 00000100:00100000:3.0:1783969202.041641:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099172608 00000100:00100000:3.0:1783969202.041645:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099172608 00000100:00100000:3.0:1783969202.041691:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969202.041698:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099172608:12345-0@lo:13: 00002000:00000024:3.0:1783969202.041727:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969202.041764:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099172608:12345-0@lo:13: Request processed in 67us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969202.041770:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969202.041788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099171584 00000100:00100000:3.0:1783969202.041792:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099171584 00000100:00100000:3.0:1783969202.041820:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099172096 00000100:00100000:3.0:1783969202.041823:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099172096 00000100:00100000:3.0:1783969202.041837:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783969202.041843:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099171584:12345-0@lo:400: 00000100:00100000:0.0:1783969202.041940:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099171328:0@lo:400: 00000100:00100000:0.0:1783969202.041955:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969202.041964:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099172736:0@lo:13: 00000100:00100000:0.0:1783969202.041996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969202.042027:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099172736 00000100:00100000:0.0:1783969202.042038:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099172736 00000100:00100000:3.0:1783969202.042046:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099171584:12345-0@lo:400: Request processed in 200us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969202.042055:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783969202.042065:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099171712:12345-0@lo:400: Request processed in 2068us (8135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969202.042066:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783969202.042078:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783969202.042079:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870627099172736:12345-0@lo:13: 00000100:00100000:1.0:1783969202.042089:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099171968 00000100:00100000:3.0:1783969202.042091:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099172096:12345-0@lo:400: 00002000:00000024:0.0:1783969202.042094:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969202.042116:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099172480 00000100:00100000:1.0:1783969202.042119:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099172480 00000100:00100000:0.0:1783969202.042130:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870627099172736:12345-0@lo:13: Request processed in 58us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.042133:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783969202.042147:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099171840:12345-0@lo:400: 00000100:00100000:1.0:1783969202.042181:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099171840:12345-0@lo:400: Request processed in 36us (7867us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.042188:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783969202.042205:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969202.042212:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099172096:12345-0@lo:400: Request processed in 124us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.042215:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1870627099172352:12345-0@lo:400: 00000100:00100000:1.0:1783969202.042250:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1870627099172352:12345-0@lo:400: Request processed in 39us (7883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.042256:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783969202.042265:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783969202.042271:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099171968:12345-0@lo:400: 00000100:00100000:1.0:1783969202.042295:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099171968:12345-0@lo:400: Request processed in 25us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.042300:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783969202.042310:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969202.042325:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099172480:12345-0@lo:400: 00000100:00100000:1.0:1783969202.042348:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099172480:12345-0@lo:400: Request processed in 33us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.042353:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1783969202.042372:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969202.042376:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969202.042378:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783969202.042467:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5f80 x1870627099172736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969202.042610:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099172736:0@lo:13: 00010000:00080000:1.0:1783969202.042630:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7210a80 x1870627099171840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969202.042648:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099171840:0@lo:400: 00010000:00080000:1.0:1783969202.042663:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff3100 x1870627099172352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969202.042671:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099172352:0@lo:400: 00000100:00100000:1.0:1783969202.042731:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099171456 00000100:00100000:1.0:1783969202.042736:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099171456 00000100:00100000:1.0:1783969202.042761:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783969202.042768:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099171456:12345-0@lo:400: 00000100:00100000:1.0:1783969202.042807:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099171456:12345-0@lo:400: Request processed in 39us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969202.042813:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783969202.042857:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099171200:0@lo:400: 00010000:00080000:1.0:1783969202.042872:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab9176680 x1870627099171712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969202.042880:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099171712:0@lo:400: 00010000:00080000:1.0:1783969202.042893:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff0e00 x1870627099172224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969202.042900:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099172224:0@lo:400: 00000100:00100000:1.0:1783969202.042993:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099171584:0@lo:400: 00000100:00100000:1.0:1783969202.043003:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099172096:0@lo:400: 00010000:00080000:1.0:1783969202.043014:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e3480 x1870627099172608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969202.043041:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099172608:0@lo:13: 00000100:00100000:1.0:1783969202.043055:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099171456:0@lo:400: 00010000:00080000:1.0:1783969202.043066:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff1500 x1870627099171968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969202.043074:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099171968:0@lo:400: 00010000:00080000:1.0:1783969202.043083:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff1180 x1870627099172480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969202.043091:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099172480:0@lo:400: 00000100:00100000:0.0:1783969202.043209:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783969202.043908:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783969202.048999:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783969202.546283:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099172864:0@lo:13: 00000100:00100000:0.0:1783969202.546422:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969202.546520:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099172864 00000100:00100000:0.0:1783969202.546531:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099172864 00000100:00100000:0.0:1783969202.546597:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783969202.546609:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099172864:12345-0@lo:13: 00002000:00000024:0.0:1783969202.546651:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969202.546715:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099172864:12345-0@lo:13: Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969202.546723:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1783969202.546799:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff1880 x1870627099172864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969202.546821:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099172864:0@lo:13: 00000100:00100000:0.0:1783969202.547154:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969202.547167:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099172992:0@lo:13: 00000100:00100000:0.0:1783969202.547201:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969202.547239:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099172992 00000100:00100000:0.0:1783969202.547242:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099172992 00000100:00100000:0.0:1783969202.547269:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783969202.547277:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099172992:12345-0@lo:13: 00002000:00000024:0.0:1783969202.547317:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969202.547352:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099172992:12345-0@lo:13: Request processed in 75us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969202.547359:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1783969202.547416:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff1880 x1870627099172992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969202.547431:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099172992:0@lo:13: 00010000:00010000:3.0:1783969202.992597:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783969203.110065:0:10337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff03e5c520 20000000:00000080:1.0:1783969203.110095:0:10337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93eab73bf800 uarg=0000000000000000 20000000:01000000:1.0:1783969203.110174:0:10337:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1783969203.110177:0:10337:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1783969203.110181:0:10337:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1783969203.110187:0:10337:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1783969203.110193:0:10337:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1783969203.110286:0:10337:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783969203.110290:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783969203.111177:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1783969203.112034:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1783969203.112075:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1783969203.112091:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1783969203.112101:0:10337:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1783969203.112104:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783969203.112951:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1783969203.113354:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1783969203.114315:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1783969203.114355:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1783969203.114371:0:10337:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783969203.114632:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783969203.115773:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1783969203.116113:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1783969203.116218:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1783969203.116323:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1783969203.116339:0:10337:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783969203.116342:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783969203.117279:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1783969203.117803:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1783969203.117832:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1783969203.117847:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1783969203.117857:0:10337:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783969203.117860:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783969203.118337:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1783969203.118874:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1783969203.118898:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1783969203.118912:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:1.0:1783969203.118925:0:10337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783969203.118952:0:10337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.118978:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb996f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.118985:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9999 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.118992:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb99d8 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.118999:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb99e6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119005:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb99f4 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119028:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a10 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119034:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a3a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119042:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a56 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119050:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9a79 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119060:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630369c expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119068:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036a3 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119078:0:10337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119276:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036a3 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.119308:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036a3 expref: 9 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969203.119330:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173120:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969203.119998:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630369c expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.120022:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630369c expref: 9 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969203.120032:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173248:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969203.120076:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9a79 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.120085:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9a79 expref: 23 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969203.120096:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173376:0@lo:104: 00000100:00100000:1.0:1783969203.120160:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969203.120215:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9a56 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.120223:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9a56 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969203.120232:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173504:0@lo:104: 00000100:00100000:1.0:1783969203.120255:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969203.120288:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9a3a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.120305:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9a3a expref: 23 pid: 6516 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969203.120314:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173632:0@lo:104: 00000100:00100000:1.0:1783969203.120334:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969203.120413:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099173376 00000100:00100000:1.0:1783969203.120423:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099173376 00000100:00100000:0.0:1783969203.120634:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099173504 00000100:00100000:0.0:1783969203.120639:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099173504 00000100:00100000:1.0:1783969203.120683:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099173632 00000100:00100000:1.0:1783969203.120687:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099173632 00000100:00100000:2.0:1783969203.120766:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783969203.120784:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:10337:x1870627099173376:12345-0@lo:104: 00010000:00010000:2.0:1783969203.120800:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.121739:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783969203.121755:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:10337:x1870627099173504:12345-0@lo:104: 00010000:00010000:0.0:1783969203.121770:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.121852:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969203.121859:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:10337:x1870627099173504:12345-0@lo:104: Request processed in 110us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969203.121867:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1783969203.122265:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969203.122275:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.122312:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969203.122317:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.122326:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969203.122334:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969203.122340:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969203.122418:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.122426:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969203.122451:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.122681:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf600/0xea31253a47cb9a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a5d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.122702:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969203.122704:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969203.122706:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969203.122844:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099173760:0@lo:103: 00000100:00100000:0.0:1783969203.122914:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969203.123023:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099173760 00000100:00100000:3.0:1783969203.123030:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099173760 00010000:00010000:3.0:1783969203.123064:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9a56 expref: 24 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969203.123100:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969203.123129:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaac72e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099173760:12345-0@lo:103: 00010000:00010000:3.0:1783969203.123146:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969203.123152:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9a56 expref: 24 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.123164:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9a56 expref: 24 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.123192:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969203.123242:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaac72e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099173760:12345-0@lo:103: Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.123250:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969203.123641:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099173760:0@lo:103: 00010000:00010000:0.0:1783969203.123878:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9a10 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.123894:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9a10 expref: 23 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.123920:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173888:0@lo:104: 00000100:00100000:0.0:1783969203.123964:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969203.124007:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb99f4 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.124016:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb99f4 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.124024:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174016:0@lo:104: 00010000:00010000:0.0:1783969203.124052:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb99e6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.124060:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb99e6 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.124068:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174144:0@lo:104: 00010000:00010000:0.0:1783969203.124092:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb99d8 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.124100:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb99d8 expref: 23 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.124108:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174272:0@lo:104: 00010000:00010000:0.0:1783969203.124142:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9999 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.124150:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9999 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.124171:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174400:0@lo:104: 00000100:00100000:3.0:1783969203.124310:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783969203.124332:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969203.124345:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969203.124353:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969203.124361:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969203.124369:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099173888 00000100:00100000:3.0:1783969203.124374:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099173888 00000100:00100000:3.0:1783969203.124436:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099174016 00000100:00100000:3.0:1783969203.124440:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099174016 00000100:00100000:3.0:1783969203.124450:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099174144 00000100:00100000:3.0:1783969203.124452:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099174144 00000100:00100000:3.0:1783969203.124813:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099174272 00000100:00100000:3.0:1783969203.124819:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099174272 00000100:00100000:3.0:1783969203.124837:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099174400 00000100:00100000:3.0:1783969203.124840:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099174400 00000100:00100000:3.0:1783969203.124855:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969203.124864:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7146c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:10337:x1870627099173888:12345-0@lo:104: 00010000:00010000:3.0:1783969203.124879:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.124954:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783969203.124960:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7146c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+9:10337:x1870627099173888:12345-0@lo:104: Request processed in 97us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.124967:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969203.124984:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969203.124988:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+8:10337:x1870627099174016:12345-0@lo:104: 00010000:00010000:3.0:1783969203.124996:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125022:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783969203.125027:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+8:10337:x1870627099174016:12345-0@lo:104: Request processed in 39us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.125033:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969203.125041:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969203.125046:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+7:10337:x1870627099174144:12345-0@lo:104: 00010000:00010000:3.0:1783969203.125052:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125075:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783969203.125079:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+7:10337:x1870627099174144:12345-0@lo:104: Request processed in 34us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.125085:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969203.125093:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969203.125098:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:10337:x1870627099174272:12345-0@lo:104: 00010000:00010000:3.0:1783969203.125105:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125137:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783969203.125141:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:10337:x1870627099174272:12345-0@lo:104: Request processed in 44us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.125148:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969203.125159:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969203.125165:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:10337:x1870627099174400:12345-0@lo:104: 00010000:00010000:3.0:1783969203.125171:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125209:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1783969203.125214:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:10337:x1870627099174400:12345-0@lo:104: Request processed in 50us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.125220:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969203.125310:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969203.125337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:3.0:1783969203.125354:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783969203.125361:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125370:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8800 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969203.125375:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125611:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969203.125620:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969203.125634:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969203.125678:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125686:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969203.125708:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125717:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad8800/0xea31253a47cb9a10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a17 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125732:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783969203.125735:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125741:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde400 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969203.125744:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125751:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969203.125757:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969203.125762:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969203.125772:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125778:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969203.125788:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125795:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb99f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125803:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783969203.125806:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125812:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf000 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969203.125814:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125822:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969203.125828:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969203.125832:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969203.125842:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125847:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969203.125857:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125862:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb99e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125872:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969203.125879:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125886:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600e00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969203.125889:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125895:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969203.125902:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969203.125907:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969203.125917:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125921:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969203.125925:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125932:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb99d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125942:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969203.125945:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125951:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601c00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969203.125954:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125969:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969203.125975:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969203.125980:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969203.125990:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.125995:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969203.125998:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.126004:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b601c00/0xea31253a47cb9999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb99a0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.126012:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969203.126014:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969203.126015:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969203.126033:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073955072 00000100:00100000:3.0:1783969203.126037:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073955072 00010000:00010000:3.0:1783969203.126059:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036a3 expref: 10 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969203.126081:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073955200 00000100:00100000:3.0:1783969203.126083:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073955200 00010000:00010000:3.0:1783969203.126095:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630369c expref: 11 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969203.126128:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:3.0:1783969203.126135:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:2391:x1870627073955072:12345-192.168.201.34@tcp:103: 00010000:00010000:3.0:1783969203.126150:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969203.126156:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036a3 expref: 11 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.126229:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb996f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.126243:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb996f expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.126260:0:10337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174528:0@lo:104: 00000100:00100000:0.0:1783969203.126343:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969203.126375:0:10337:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9874ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969203.126672:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173120:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969203.126683:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173248:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969203.126694:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cde000/0xea31253a47cb9a5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9a56 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.126707:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173504:0@lo:104: 00000100:00100000:0.0:1783969203.126725:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173888:0@lo:104: 00000100:00100000:0.0:1783969203.126733:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174016:0@lo:104: 00000100:00100000:0.0:1783969203.126740:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174144:0@lo:104: 00000100:00100000:0.0:1783969203.126748:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174272:0@lo:104: 00000100:00100000:0.0:1783969203.126755:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174400:0@lo:104: 00010000:00010000:3.0:1783969203.126820:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036a3 expref: 11 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.126838:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9a9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036a3 expref: 11 pid: 6516 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.126853:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969203.126910:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073955072:12345-192.168.201.34@tcp:103: Request processed in 774us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.126919:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:3.0:1783969203.126940:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1783969203.126947:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:2391:x1870627073955200:12345-192.168.201.34@tcp:103: 00010000:00010000:3.0:1783969203.126958:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969203.126963:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630369c expref: 9 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.126974:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630369c expref: 9 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.126984:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601400/0xea31253a47cb9a95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630369c expref: 9 pid: 6514 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.127000:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969203.127016:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:2391:x1870627073955200:12345-192.168.201.34@tcp:103: Request processed in 70us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.127023:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1783969203.127052:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099174656:0@lo:103: 00000100:00100000:3.0:1783969203.127086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969203.127107:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099175168:0@lo:103: 00000100:00100000:1.0:1783969203.127273:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099174528 00000100:00100000:1.0:1783969203.127279:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099174528 00000100:00100000:1.0:1783969203.127333:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783969203.127340:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:10337:x1870627099173632:12345-0@lo:104: 00010000:00010000:1.0:1783969203.127353:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.127574:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969203.127580:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:10337:x1870627099173632:12345-0@lo:104: Request processed in 241us (7245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969203.127587:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783969203.127601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969203.127607:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:10337:x1870627099174528:12345-0@lo:104: 00010000:00010000:1.0:1783969203.127615:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.127639:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783969203.127643:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:10337:x1870627099174528:12345-0@lo:104: Request processed in 37us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969203.127649:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783969203.127981:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173632:0@lo:104: 00000100:00100000:0.0:1783969203.127997:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099174528:0@lo:104: 00000100:00100000:3.0:1783969203.128251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969203.128324:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969203.128333:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099174784:0@lo:103: 00000100:00100000:3.0:1783969203.128375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969203.128485:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783969203.128494:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:10337:x1870627099173376:12345-0@lo:104: Request processed in 7715us (8333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969203.128503:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783969203.128803:0:10337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1870627099173376:0@lo:104: 00010000:00010000:1.0:1783969203.128871:0:10337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969203.129094:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099175040:0@lo:103: 00000100:00100000:3.0:1783969203.129137:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969203.129154:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099174656 00000100:00100000:0.0:1783969203.129168:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099174656 00010000:00010000:0.0:1783969203.129206:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9a10 expref: 23 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.129225:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099175168 00000100:00100000:0.0:1783969203.129228:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099175168 00010000:00010000:0.0:1783969203.129249:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9999 expref: 24 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.129259:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099174784 00000100:00100000:0.0:1783969203.129262:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099174784 00010000:00010000:0.0:1783969203.129270:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb99f4 expref: 25 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.129281:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783969203.129288:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:3646:x1870627099174656:12345-0@lo:103: 00010000:00010000:0.0:1783969203.129313:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969203.129318:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9a10 expref: 25 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.129329:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9a10 expref: 25 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.129348:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9a17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9a10 expref: 25 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.129366:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969203.129861:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099174656:12345-0@lo:103: Request processed in 571us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969203.129871:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783969203.129893:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783969203.129907:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:3646:x1870627099175168:12345-0@lo:103: 00010000:00010000:0.0:1783969203.129919:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969203.129924:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9999 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.129935:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9999 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.129946:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad9400/0xea31253a47cb99a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9999 expref: 23 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.129957:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969203.129982:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:3646:x1870627099175168:12345-0@lo:103: Request processed in 76us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969203.129989:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783969203.130001:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783969203.130007:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3646:x1870627099174784:12345-0@lo:103: 00010000:00010000:0.0:1783969203.130015:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969203.130019:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb99f4 expref: 21 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.130026:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb99f4 expref: 21 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.130035:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdec00/0xea31253a47cb99fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb99f4 expref: 21 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.130044:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969203.130063:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3646:x1870627099174784:12345-0@lo:103: Request processed in 56us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969203.130078:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783969203.130273:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099175040 00000100:00100000:0.0:1783969203.130280:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099175040 00010000:00010000:0.0:1783969203.130309:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb99d8 expref: 20 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.130325:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969203.130331:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3649:x1870627099175040:12345-0@lo:103: 00010000:00010000:0.0:1783969203.130351:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969203.130356:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb99d8 expref: 20 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.130364:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb99d8 expref: 20 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.130403:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796c00/0xea31253a47cb99df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb99d8 expref: 20 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.130414:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969203.130439:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:3649:x1870627099175040:12345-0@lo:103: Request processed in 109us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969203.130456:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969203.130951:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099175040:0@lo:103: 00000100:00100000:3.0:1783969203.130975:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969203.130987:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099174912:0@lo:103: 00000100:00100000:3.0:1783969203.131038:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969203.131085:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099174912 00000100:00100000:3.0:1783969203.131089:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099174912 00010000:00010000:3.0:1783969203.131109:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb99e6 expref: 19 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969203.131135:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783969203.131150:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2119850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:3649:x1870627099174912:12345-0@lo:103: 00010000:00010000:3.0:1783969203.131160:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969203.131174:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb99e6 expref: 19 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.131183:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb99e6 expref: 19 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.131782:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797200/0xea31253a47cb99ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb99e6 expref: 19 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.131801:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969203.131851:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2119850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3649:x1870627099174912:12345-0@lo:103: Request processed in 709us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.131857:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783969203.131925:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099174912:0@lo:103: 00010000:00010000:3.0:1783969203.131948:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783969203.131957:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.131965:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969203.131971:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.131981:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969203.131988:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969203.131993:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969203.132031:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132045:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969203.132065:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132072:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad8600/0xea31253a47cb9a3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132085:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969203.132089:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132095:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797000 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969203.132098:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132106:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969203.132113:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969203.132246:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099174656:0@lo:103: 00000100:00100000:1.0:1783969203.132272:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099175168:0@lo:103: 00000100:00100000:1.0:1783969203.132285:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969203.132308:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099175296:0@lo:103: 00000100:00100000:1.0:1783969203.132344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969203.132598:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099174784:0@lo:103: 10000000:01000000:3.0:1783969203.132693:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969203.132713:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132719:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969203.132744:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132750:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eab7797000/0xea31253a47cb996f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9976 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132767:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969203.132771:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132776:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8400 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969203.132779:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132786:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969203.132792:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969203.132797:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969203.132812:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132818:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969203.132823:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132829:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad8400/0xea31253a47cb9a79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9a80 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132842:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969203.132844:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969203.132845:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969203.132865:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099175296 00000100:00100000:3.0:1783969203.132877:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099175296 00010000:00010000:3.0:1783969203.132902:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9a3a expref: 18 pid: 6516 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969203.132926:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783969203.132934:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3646:x1870627099175296:12345-0@lo:103: 00010000:00010000:3.0:1783969203.132947:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969203.132951:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9a3a expref: 18 pid: 6516 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132959:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9a3a expref: 18 pid: 6516 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132972:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797400/0xea31253a47cb9a41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9a3a expref: 18 pid: 6516 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969203.132983:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969203.133022:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:3646:x1870627099175296:12345-0@lo:103: Request processed in 88us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969203.133029:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1783969203.133059:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969203.133075:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099175296:0@lo:103: 00000100:00100000:1.0:1783969203.133677:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099175552:0@lo:103: 00000100:00100000:1.0:1783969203.133727:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969203.133759:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969203.133782:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099175424:0@lo:103: 00000100:00100000:1.0:1783969203.133804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969203.134005:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099175552 00000100:00100000:0.0:1783969203.134012:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099175552 00010000:00010000:0.0:1783969203.134039:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9a79 expref: 17 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.134070:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099175424 00000100:00100000:0.0:1783969203.134073:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099175424 00010000:00010000:0.0:1783969203.134085:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb996f expref: 18 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969203.134112:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783969203.134128:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:3649:x1870627099175552:12345-0@lo:103: 00010000:00010000:0.0:1783969203.134142:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969203.134147:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9a79 expref: 18 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134158:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9a79 expref: 18 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134171:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad8c00/0xea31253a47cb9a80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9a79 expref: 18 pid: 6515 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134185:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969203.134236:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:3649:x1870627099175552:12345-0@lo:103: Request processed in 110us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969203.134243:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783969203.134259:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969203.134264:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:3649:x1870627099175424:12345-0@lo:103: 00010000:00010000:0.0:1783969203.134272:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969203.134276:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb996f expref: 16 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134284:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb996f expref: 16 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134294:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad9a00/0xea31253a47cb9976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb996f expref: 16 pid: 6514 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134329:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134338:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134355:0:7929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134362:0:7929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134369:0:7929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134619:0:7929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134628:0:7929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969203.134633:0:7929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134641:0:7929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134654:0:7929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969203.134665:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969203.134694:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:3649:x1870627099175424:12345-0@lo:103: Request processed in 429us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969203.134709:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969203.134752:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099175424:0@lo:103: 00000100:00100000:0.0:1783969203.134761:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099175552:0@lo:103: 00010000:00010000:1.0:1783969203.134969:0:10337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.134979:0:10337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969203.134985:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9adb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969203.138707:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969204.016796:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783969205.041628:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783969205.041640:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93e98212a000 from 48 10000000:01000000:2.0:1783969205.041648:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783969205.041723:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.041737:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.041751:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969205.041811:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099175680:0@lo:101: 00000100:00100000:2.0:1783969205.041913:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.042065:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064600 going to sleep for 11 seconds 00000100:00100000:1.0:1783969205.042820:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099175680 00000100:00100000:1.0:1783969205.042833:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099175680 00000100:00100000:1.0:1783969205.042912:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1783969205.042924:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+15:6518:x1870627099175680:12345-0@lo:101: 00010000:00010000:1.0:1783969205.042942:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969205.042962:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9ae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9ae2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.043007:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9ae2 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.043019:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9ae2 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.043029:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b601000, rc 0) 00000100:00100000:1.0:1783969205.043106:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099175680:12345-0@lo:101: Request processed in 185us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.043115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00010000:3.0:1783969205.043626:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969205.048533:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099175680:0@lo:101: 00010000:00010000:0.0:1783969205.048581:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.048598:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969205.048756:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099175808:0@lo:501: 00000100:00100000:0.0:1783969205.048845:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.048910:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969205.049430:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099175808 00000100:00100000:1.0:1783969205.049439:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099175808 00000100:00100000:1.0:1783969205.049516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783969205.049529:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099175808:12345-0@lo:501: 00000100:00100000:1.0:1783969205.049722:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099175808:12345-0@lo:501: Request processed in 195us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.049731:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783969205.050606:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099175808:0@lo:501: 00000100:00100000:0.0:1783969205.050668:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099175936:0@lo:503: 00000100:00100000:0.0:1783969205.050745:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.051756:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969205.068678:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099175936 00000100:00100000:2.0:1783969205.068702:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099175936 00000100:00100000:2.0:1783969205.068813:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783969205.068827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099175936:12345-0@lo:503: 00000100:00100000:2.0:1783969205.069066:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099175936:12345-0@lo:503: Request processed in 242us (18320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.070484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783969205.071120:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099175936:0@lo:503: 00000100:00100000:0.0:1783969205.075928:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10354:1870627099176064:0@lo:502: 00000100:00100000:0.0:1783969205.076034:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.076187:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969205.077916:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099176064 00000100:00100000:1.0:1783969205.077935:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099176064 00000100:00100000:1.0:1783969205.078094:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1783969205.078108:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:10354:x1870627099176064:12345-0@lo:502: 00000100:00100000:1.0:1783969205.078477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:10354:x1870627099176064:12345-0@lo:502: Request processed in 371us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.078489:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1783969205.078795:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10354:1870627099176064:0@lo:502: 00000100:00100000:0.0:1783969205.078884:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10354:1870627099176192:0@lo:502: 00000100:00100000:0.0:1783969205.078942:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.091496:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969205.092024:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099176192 00000100:00100000:2.0:1783969205.092038:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099176192 00000100:00100000:2.0:1783969205.095091:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783969205.095121:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:10354:x1870627099176192:12345-0@lo:502: 00000100:00100000:2.0:1783969205.095727:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:10354:x1870627099176192:12345-0@lo:502: Request processed in 617us (16782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.095738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783969205.100901:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10354:1870627099176192:0@lo:502: 00000040:00080000:0.0:1783969205.100984:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783969205.101709:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783969205.101745:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783969205.101763:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.101778:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969205.101791:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783969205.101816:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1783969205.101820:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783969205.101869:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.101879:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.101890:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969205.101918:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099176320:0@lo:101: 00000100:00100000:2.0:1783969205.102013:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.102095:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064480 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.102815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099176320 00000100:00100000:3.0:1783969205.102827:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099176320 00000100:00100000:3.0:1783969205.102909:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783969205.102921:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+16:6518:x1870627099176320:12345-0@lo:101: 00010000:00010000:3.0:1783969205.102942:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969205.102970:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797400/0xea31253a47cb9af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9af0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.103005:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797400/0xea31253a47cb9af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9af0 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.103018:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797400/0xea31253a47cb9af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9af0 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.103028:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797400, rc 0) 00000100:00100000:3.0:1783969205.103116:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099176320:12345-0@lo:101: Request processed in 198us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969205.103224:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099176320:0@lo:101: 00010000:00010000:0.0:1783969205.103244:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.103255:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969205.103377:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099176448:0@lo:501: 00000100:00100000:0.0:1783969205.103464:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.103495:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.103895:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783969205.103936:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099176448 00000100:00100000:3.0:1783969205.103940:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099176448 00000100:00100000:3.0:1783969205.103959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783969205.103965:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099176448:12345-0@lo:501: 00000100:00100000:3.0:1783969205.104221:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099176448:12345-0@lo:501: Request processed in 254us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.104229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1783969205.104658:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099176448:0@lo:501: 00000100:00100000:0.0:1783969205.104708:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099176576:0@lo:503: 00000100:00100000:0.0:1783969205.104768:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.104796:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.104863:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099176576 00000100:00100000:3.0:1783969205.104867:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099176576 00000100:00100000:3.0:1783969205.104905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783969205.104912:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099176576:12345-0@lo:503: 00000100:00100000:3.0:1783969205.105019:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099176576:12345-0@lo:503: Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.105027:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1783969205.107819:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099176576:0@lo:503: 00000100:00100000:2.0:1783969205.113332:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10355:1870627099176704:0@lo:502: 00000100:00100000:2.0:1783969205.113502:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.113568:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.114511:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099176704 00000100:00100000:3.0:1783969205.114525:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099176704 00000100:00100000:3.0:1783969205.114619:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783969205.114630:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:10355:x1870627099176704:12345-0@lo:502: 00000100:00100000:3.0:1783969205.114839:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:10355:x1870627099176704:12345-0@lo:502: Request processed in 211us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.114847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783969205.115365:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10355:1870627099176704:0@lo:502: 00000020:01000000:0.0:1783969205.115448:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969205.115462:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969205.115464:0:10355:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783969205.115471:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783969205.115520:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10355:1870627099176832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969205.115584:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.115628:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.115871:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099176832 00000100:00100000:3.0:1783969205.115879:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099176832 00000100:00100000:3.0:1783969205.115923:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1783969205.115930:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:10355:x1870627099176832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969205.116046:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:10355:x1870627099176832:12345-0@lo:502:llog_process_th.0 Request processed in 116us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.116054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1783969205.116788:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10355:1870627099176832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969205.116828:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969205.116837:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969205.116839:0:10355:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783969205.116844:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1783969205.117099:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783969205.117129:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783969205.117144:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.117158:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969205.117170:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783969205.117173:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93eab70d7000 from 48 10000000:01000000:2.0:1783969205.117176:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783969205.117219:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.117242:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.117253:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969205.117293:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099176960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.117370:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.117807:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea860646c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.117877:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099176960 00000100:00100000:3.0:1783969205.117884:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099176960 00000100:00100000:3.0:1783969205.117935:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783969205.117943:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+17:6518:x1870627099176960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969205.117960:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969205.117978:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797000/0xea31253a47cb9b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9afe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.118010:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797000/0xea31253a47cb9b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9afe expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.118021:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797000/0xea31253a47cb9b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9afe expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.118031:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797000, rc 0) 00000100:00100000:3.0:1783969205.118094:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099176960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.118115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1783969205.118311:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099176960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969205.118329:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.118339:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969205.118467:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.118503:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.118520:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea860646c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.119006:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099177088 00000100:00100000:3.0:1783969205.119012:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099177088 00000100:00100000:3.0:1783969205.119050:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783969205.119058:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099177088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.119234:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099177088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.119242:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783969205.119658:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.119705:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.119764:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969205.119798:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969205.119854:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099177216 00000100:00100000:2.0:1783969205.119859:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099177216 00000100:00100000:2.0:1783969205.119893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1783969205.119901:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099177216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.119997:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099177216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.120004:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783969205.120103:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.120653:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10356:1870627099177344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969205.120708:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969205.120742:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824cfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969205.120966:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099177344 00000100:00100000:2.0:1783969205.120971:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099177344 00000100:00100000:2.0:1783969205.121008:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783969205.121016:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:10356:x1870627099177344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969205.121159:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:10356:x1870627099177344:12345-0@lo:502:llog_process_th.0 Request processed in 143us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.121166:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783969205.121259:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10356:1870627099177344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969205.121318:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10356:1870627099177472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969205.121360:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969205.121410:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.121636:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099177472 00000100:00100000:3.0:1783969205.121641:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099177472 00000100:00100000:3.0:1783969205.121665:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783969205.121676:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:10356:x1870627099177472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969205.121788:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:10356:x1870627099177472:12345-0@lo:502:llog_process_th.0 Request processed in 112us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.121795:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783969205.122058:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10356:1870627099177472:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783969205.122101:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783969205.122652:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783969205.122686:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783969205.122700:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.122716:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969205.122727:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783969205.122730:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1783969205.122735:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783969205.122777:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.122786:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.122798:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969205.122822:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.122876:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.122925:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.123297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099177600 00000100:00100000:3.0:1783969205.123307:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099177600 00000100:00100000:3.0:1783969205.123374:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783969205.123421:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+18:6518:x1870627099177600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969205.123437:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969205.123455:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797200/0xea31253a47cb9b13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9b0c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.123501:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797200/0xea31253a47cb9b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9b0c expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.123514:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797200/0xea31253a47cb9b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b0c expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.123527:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797200, rc 0) 00000100:00100000:3.0:1783969205.123585:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099177600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.123593:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783969205.123801:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969205.123819:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.123830:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969205.123914:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.123958:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.123992:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969205.124081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099177728 00000100:00100000:0.0:1783969205.124093:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099177728 00000100:00100000:0.0:1783969205.124131:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783969205.124139:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099177728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969205.124290:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099177728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969205.124298:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783969205.124580:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.124615:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.124671:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.124694:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.125098:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099177856 00000100:00100000:3.0:1783969205.125104:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099177856 00000100:00100000:3.0:1783969205.125143:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783969205.125151:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099177856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.125274:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099177856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.125281:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783969205.125365:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099177856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.126046:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10357:1870627099177984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969205.126115:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.126152:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.126675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099177984 00000100:00100000:3.0:1783969205.126682:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099177984 00000100:00100000:3.0:1783969205.126723:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1783969205.126732:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:10357:x1870627099177984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969205.126871:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:10357:x1870627099177984:12345-0@lo:502:llog_process_th.0 Request processed in 139us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.126878:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783969205.127237:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10357:1870627099177984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969205.127283:0:10357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969205.127295:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969205.127298:0:10357:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783969205.127303:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783969205.127331:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10357:1870627099178112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969205.127446:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.127471:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.127610:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099178112 00000100:00100000:3.0:1783969205.127615:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099178112 00000100:00100000:3.0:1783969205.127654:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1783969205.127660:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:10357:x1870627099178112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969205.127743:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:10357:x1870627099178112:12345-0@lo:502:llog_process_th.0 Request processed in 82us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.127750:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783969205.127824:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10357:1870627099178112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969205.127845:0:10357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969205.127850:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969205.127852:0:10357:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783969205.127857:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1783969205.128177:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1783969205.128204:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783969205.128216:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.128229:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969205.128240:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783969205.128244:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93eab929d800 from 48 10000000:01000000:3.0:1783969205.128247:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969205.128290:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.128299:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.128309:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969205.128325:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099178240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.128377:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969205.128441:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da2900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969205.128557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099178240 00000100:00100000:1.0:1783969205.128563:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099178240 00000100:00100000:1.0:1783969205.128604:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1783969205.128612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:6518:x1870627099178240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969205.128625:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969205.128643:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b600600/0xea31253a47cb9b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9b1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.128672:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b600600/0xea31253a47cb9b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9b1a expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.128699:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b600600/0xea31253a47cb9b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b1a expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.128710:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600600, rc 0) 00000100:00100000:1.0:1783969205.128745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099178240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.128752:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1783969205.129414:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099178240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969205.129447:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.129458:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969205.129536:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099178368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.129572:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969205.129602:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da2900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969205.130737:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099178368 00000100:00100000:2.0:1783969205.130748:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099178368 00000100:00100000:2.0:1783969205.130816:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1783969205.130827:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099178368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.131013:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099178368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.131021:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783969205.131871:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099178368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.131938:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099178496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.132017:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969205.132049:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da2900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969205.132316:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969205.132540:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099178496 00000100:00100000:2.0:1783969205.132547:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099178496 00000100:00100000:2.0:1783969205.132595:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073955328 00000100:00100000:2.0:1783969205.132598:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073955328 00000100:00100000:2.0:1783969205.132616:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783969205.132624:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099178496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.132750:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099178496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.132757:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783969205.132800:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:2.0:1783969205.132807:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:6166:x1870627073955328:12345-192.168.201.34@tcp:101: 00010000:00010000:2.0:1783969205.132817:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969205.132843:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad8400/0xea31253a47cb9b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.132875:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad8400/0xea31253a47cb9b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303713 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.132888:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad8400/0xea31253a47cb9b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303713 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.132912:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad8400, rc 0) 00000100:00100000:2.0:1783969205.132954:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6166:x1870627073955328:12345-192.168.201.34@tcp:101: Request processed in 148us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.132961:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:3.0:1783969205.133743:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099178496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969205.139119:0:10358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10358:1870627099178624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969205.139275:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.139334:0:10358:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969205.139665:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099178624 00000100:00100000:2.0:1783969205.139677:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099178624 00000100:00100000:2.0:1783969205.139747:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783969205.139760:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:10358:x1870627099178624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969205.139947:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:10358:x1870627099178624:12345-0@lo:502:llog_process_th.0 Request processed in 188us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.139956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783969205.143791:0:10358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10358:1870627099178624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969205.143918:0:10358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10358:1870627099178752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969205.144018:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969205.144178:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099178752 00000100:00100000:1.0:1783969205.144186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099178752 00000100:00100000:1.0:1783969205.144245:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783969205.144255:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:10358:x1870627099178752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969205.144490:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:10358:x1870627099178752:12345-0@lo:502:llog_process_th.0 Request processed in 235us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.144499:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783969205.144745:0:10358:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969205.144766:0:10358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10358:1870627099178752:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783969205.144792:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783969205.144999:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1783969205.145033:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783969205.145048:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.145061:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969205.145073:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783969205.145076:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1783969205.145080:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783969205.145128:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.145151:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.145165:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969205.145185:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099178880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.145226:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969205.145262:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da2900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969205.145410:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099178880 00000100:00100000:1.0:1783969205.145416:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099178880 00000100:00100000:1.0:1783969205.145450:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783969205.145458:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099178880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969205.145470:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969205.145487:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b600400/0xea31253a47cb9b36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9b2f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.145515:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b600400/0xea31253a47cb9b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9b2f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.145529:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b600400/0xea31253a47cb9b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b2f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.145545:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600400, rc 0) 00000100:00100000:1.0:1783969205.145586:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099178880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.145593:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1783969205.145872:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099178880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969205.145890:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.145901:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969205.145963:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.145994:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969205.146020:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da2900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969205.147588:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099179008 00000100:00100000:1.0:1783969205.147607:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099179008 00000100:00100000:1.0:1783969205.147679:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783969205.147690:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099179008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.147911:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099179008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.147920:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783969205.148949:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.149030:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.149147:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969205.149187:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da2900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969205.149839:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969205.149905:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099179136 00000100:00100000:1.0:1783969205.149912:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099179136 00000100:00100000:1.0:1783969205.149964:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073955456 00000100:00100000:1.0:1783969205.149967:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073955456 00000100:00100000:1.0:1783969205.149984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1783969205.149993:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099179136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.150204:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099179136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.150213:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1783969205.150256:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00100000:1.0:1783969205.150272:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6166:x1870627073955456:12345-192.168.201.34@tcp:501: 00000100:00100000:1.0:1783969205.150864:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6166:x1870627073955456:12345-192.168.201.34@tcp:501: Request processed in 597us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.150874:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00100000:3.0:1783969205.151717:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.152878:0:10359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10359:1870627099179264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969205.152970:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.153021:0:10359:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969205.153092:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099179264 00000100:00100000:0.0:1783969205.153108:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099179264 00000100:00100000:0.0:1783969205.153632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783969205.153646:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:10359:x1870627099179264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969205.153823:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:10359:x1870627099179264:12345-0@lo:502:llog_process_th.0 Request processed in 180us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969205.153832:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783969205.153999:0:10359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10359:1870627099179264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969205.154039:0:10359:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969205.154050:0:10359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969205.154053:0:10359:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783969205.154060:0:10359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783969205.154110:0:10359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10359:1870627099179392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969205.154611:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.154654:0:10359:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.154715:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099179392 00000100:00100000:3.0:1783969205.154729:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099179392 00000100:00100000:3.0:1783969205.154765:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783969205.154773:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:10359:x1870627099179392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969205.154883:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:10359:x1870627099179392:12345-0@lo:502:llog_process_th.0 Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.154890:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1783969205.157982:0:10359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10359:1870627099179392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969205.158057:0:10359:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969205.158103:0:10359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969205.158106:0:10359:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783969205.158111:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1783969205.164861:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1783969205.164920:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783969205.164936:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.164952:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969205.164965:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783969205.164969:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93ea912c9800 from 48 10000000:01000000:3.0:1783969205.164972:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969205.165021:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.165030:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.165043:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969205.165095:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.165274:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969205.165424:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969205.165501:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.171252:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099179520 00000100:00100000:3.0:1783969205.171301:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099179520 00000100:00100000:3.0:1783969205.171375:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073955584 00000100:00100000:3.0:1783969205.171402:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073955584 00000100:00100000:3.0:1783969205.171429:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783969205.171440:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099179520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969205.171463:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969205.171489:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796800/0xea31253a47cb9b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9b3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.171528:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796800/0xea31253a47cb9b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9b3d expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.171543:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796800/0xea31253a47cb9b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b3d expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.171554:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796800, rc 0) 00000100:00100000:3.0:1783969205.171653:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099179520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (6389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.171661:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783969205.171700:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:3.0:1783969205.171706:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6166:x1870627073955584:12345-192.168.201.34@tcp:503: 00000100:00100000:3.0:1783969205.171858:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6166:x1870627073955584:12345-192.168.201.34@tcp:503: Request processed in 151us (6437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.171866:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:1.0:1783969205.172250:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969205.172285:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.172298:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969205.172426:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.172472:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969205.172506:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.172866:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099179648 00000100:00100000:3.0:1783969205.172871:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099179648 00000100:00100000:3.0:1783969205.172909:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783969205.172916:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099179648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.173060:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099179648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.173077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783969205.173709:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.173760:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.173831:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969205.173868:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.173918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099179776 00000100:00100000:3.0:1783969205.173924:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099179776 00000100:00100000:3.0:1783969205.173962:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783969205.173969:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099179776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.174232:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099179776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.174240:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783969205.174333:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099179776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.174832:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10360:1870627099179904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969205.174883:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969205.174916:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969205.174966:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099179904 00000100:00100000:0.0:1783969205.174972:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099179904 00000100:00100000:0.0:1783969205.175013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783969205.175022:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:10360:x1870627099179904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969205.175170:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:10360:x1870627099179904:12345-0@lo:502:llog_process_th.0 Request processed in 149us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969205.175178:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783969205.177931:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10360:1870627099179904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969205.178077:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10360:1870627099180032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969205.178209:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969205.178278:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969205.179656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969205.179767:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099180032 00000100:00100000:1.0:1783969205.179777:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099180032 00000100:00100000:1.0:1783969205.179827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073955712 00000100:00100000:1.0:1783969205.179830:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073955712 00000100:00100000:1.0:1783969205.179844:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783969205.179854:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:10360:x1870627099180032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969205.180026:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:10360:x1870627099180032:12345-0@lo:502:llog_process_th.0 Request processed in 173us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.180034:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783969205.180078:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:1.0:1783969205.180090:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6647:x1870627073955712:12345-192.168.201.34@tcp:502: 00000100:00100000:1.0:1783969205.180159:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6647:x1870627073955712:12345-192.168.201.34@tcp:502: Request processed in 68us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.180166:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:3.0:1783969205.180437:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10360:1870627099180032:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783969205.180479:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783969205.180697:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1783969205.180720:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969205.180732:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.180746:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969205.180758:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783969205.180761:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1783969205.180764:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783969205.180800:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.180808:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.180819:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969205.180841:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.180877:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969205.180912:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969205.181572:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099180160 00000100:00100000:3.0:1783969205.181580:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099180160 00000100:00100000:3.0:1783969205.181654:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1783969205.181662:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099180160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969205.181677:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969205.181703:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796a00/0xea31253a47cb9b52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9b4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.181729:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796a00/0xea31253a47cb9b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9b4b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.181741:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796a00/0xea31253a47cb9b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b4b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969205.181751:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796a00, rc 0) 00000100:00100000:3.0:1783969205.181798:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099180160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.181804:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783969205.181875:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969205.181899:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969205.181909:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969205.181970:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.181997:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969205.183061:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969205.183490:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099180288 00000100:00100000:2.0:1783969205.183500:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099180288 00000100:00100000:3.0:1783969205.183710:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783969205.183721:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099180288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969205.183941:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099180288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969205.183951:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783969205.184029:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.184336:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.192787:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.192858:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969205.192955:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099180416 00000100:00100000:1.0:1783969205.192966:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099180416 00000100:00100000:1.0:1783969205.193036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783969205.193050:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099180416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.193807:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099180416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 755us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969205.193819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1783969205.193929:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969205.194726:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10361:1870627099180544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969205.194782:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969205.194823:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969205.194867:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099180544 00000100:00100000:0.0:1783969205.194873:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099180544 00000100:00100000:0.0:1783969205.194916:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783969205.194925:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:10361:x1870627099180544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969205.195051:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:10361:x1870627099180544:12345-0@lo:502:llog_process_th.0 Request processed in 127us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969205.195059:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1783969205.195302:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10361:1870627099180544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969205.195478:0:10361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969205.195490:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969205.195493:0:10361:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783969205.195499:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783969205.195528:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10361:1870627099180672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969205.195576:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969205.195587:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969205.195761:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099180672 00000100:00100000:0.0:1783969205.195766:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099180672 00000100:00100000:0.0:1783969205.195785:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783969205.195791:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:10361:x1870627099180672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969205.195878:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:10361:x1870627099180672:12345-0@lo:502:llog_process_th.0 Request processed in 87us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969205.195893:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783969205.196725:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969205.196815:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10361:1870627099180672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969205.196854:0:10361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969205.196861:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969205.196863:0:10361:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783969205.196867:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783969205.197065:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1783969205.197107:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783969205.197121:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.197364:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969205.197377:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783969205.197557:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93eaa5b00000 from 1 10000000:01000000:0.0:1783969205.197562:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783969205.197601:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.197610:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.197620:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969205.197644:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969205.197694:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.197732:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969205.197895:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073955840 00000100:00100000:2.0:1783969205.197902:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073955840 00000100:00100000:2.0:1783969205.197948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099180800 00000100:00100000:2.0:1783969205.197951:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099180800 00000100:00100000:2.0:1783969205.197969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 246 00000100:00100000:2.0:1783969205.197977:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6647:x1870627073955840:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969205.198317:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6647:x1870627073955840:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 338us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.198333:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 246 00000100:00100000:2.0:1783969205.198371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1783969205.198408:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099180800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969205.198419:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969205.198437:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad8600/0xea31253a47cb9b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9b59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.198463:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad8600/0xea31253a47cb9b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9b59 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.198475:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad8600/0xea31253a47cb9b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b59 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969205.198484:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad8600, rc 0) 00000100:00100000:2.0:1783969205.198523:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099180800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969205.198541:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783969205.198889:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969205.198907:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.198933:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969205.199018:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969205.199056:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969205.199101:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea90a5b900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969205.199118:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099180928 00000100:00100000:0.0:1783969205.199123:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099180928 00000100:00100000:0.0:1783969205.199146:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783969205.199153:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099180928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969205.199224:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099180928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (167us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783969205.199231:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783969205.199253:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099180928:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783969205.199303:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783969205.199310:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.199318:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969205.210825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969205.210931:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073955968 00000100:00100000:0.0:1783969205.210944:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073955968 00000100:00100000:0.0:1783969205.211016:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 249 00000100:00100000:0.0:1783969205.211029:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6166:x1870627073955968:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969205.211098:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969205.211134:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cde800/0xea31253a47cb9b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d35630371a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.211174:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cde800/0xea31253a47cb9b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630371a expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.211188:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cde800/0xea31253a47cb9b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630371a expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969205.211198:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde800, rc 0) 00000100:00100000:0.0:1783969205.211291:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6166:x1870627073955968:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 263us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969205.211300:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 249 00000100:00100000:1.0:1783969205.219594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969205.220259:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073956096 00000100:00100000:2.0:1783969205.220281:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073956096 00000100:00100000:2.0:1783969205.220367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 250 00000100:00100000:2.0:1783969205.220422:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6166:x1870627073956096:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969205.220578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6166:x1870627073956096:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 199us (999us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969205.220588:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 250 00010000:00010000:2.0:1783969206.064575:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969206.129864:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969206.129899:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099181056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969206.129999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969206.130088:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099181056 00000100:00100000:3.0:1783969206.130097:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099181056 00000100:00100000:3.0:1783969206.130175:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969206.130186:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099181056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969206.130229:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783969206.130294:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099181056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969206.130326:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969206.130859:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099181056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969206.640943:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969206.640997:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099181184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969206.641115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969206.641217:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099181184 00000100:00100000:2.0:1783969206.641227:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099181184 00000100:00100000:2.0:1783969206.641309:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783969206.641320:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099181184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969206.641407:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969206.641460:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099181184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969206.641469:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783969206.641528:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099181184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969207.053437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969207.053491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969207.053551:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969207.053573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969207.053595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969207.053624:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073956352 00000100:00100000:1.0:1783969207.053635:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073956352 00000100:00100000:1.0:1783969207.053828:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073956480 00000100:00100000:1.0:1783969207.053832:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073956480 00000100:00100000:1.0:1783969207.053856:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1783969207.053867:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073956352:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969207.053957:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073956352:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 92us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969207.053965:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1783969207.053982:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1783969207.053987:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073956480:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969207.054006:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073956480:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 20us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969207.054012:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1783969207.054029:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073956608 00000100:00100000:1.0:1783969207.054032:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073956608 00000100:00100000:1.0:1783969207.054053:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073956736 00000100:00100000:1.0:1783969207.054055:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073956736 00000100:00100000:1.0:1783969207.054071:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1783969207.054076:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073956608:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969207.054097:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073956608:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 21us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969207.054103:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1783969207.054119:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1783969207.054124:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073956736:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969207.054150:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073956736:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969207.054156:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00080000:1.0:1783969207.054172:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969207.054177:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969207.054180:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969207.054182:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969207.054979:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073956224 00000100:00100000:3.0:1783969207.054988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073956224 00000100:00100000:3.0:1783969207.055130:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 251 00000100:00100000:3.0:1783969207.055141:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627073956224:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969207.055205:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627073956224:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 66us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.055213:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 251 00000020:00000080:3.0:1783969207.089140:0:10399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe46210700 20000000:00000080:3.0:1783969207.089168:0:10399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93eabbff8400 uarg=0000000000000000 20000000:01000000:3.0:1783969207.089226:0:10399:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783969207.089244:0:10399:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783969207.089251:0:10399:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00010000:00010000:0.0:1783969207.089966:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783969207.091018:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1783969207.091674:0:10399:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1783969207.099049:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1783969207.099106:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1783969207.099895:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1783969207.099930:0:10399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783969207.099957:0:10399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.099981:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea80031000/0xea31253a47cb980a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9803 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.099990:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9811 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100018:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9865 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100025:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb998b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100035:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036db expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100042:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100104:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036db expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100120:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036db expref: 9 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969207.100154:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181312:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969207.100369:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb998b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100394:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb998b expref: 23 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969207.100407:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181440:0@lo:104: 00000100:00100000:3.0:1783969207.100459:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969207.100504:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9865 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100520:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9865 expref: 23 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969207.100530:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181568:0@lo:104: 00000100:00100000:3.0:1783969207.100556:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969207.100586:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9811 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100593:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9811 expref: 23 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969207.100601:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181696:0@lo:104: 00010000:00010000:3.0:1783969207.100624:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea80031000/0xea31253a47cb980a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9803 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.100631:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea80031000/0xea31253a47cb980a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9803 expref: 23 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969207.100639:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181824:0@lo:104: 00000100:00100000:3.0:1783969207.100672:0:10399:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969207.100792:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783969207.100815:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969207.100843:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969207.100854:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099181440 00000100:00100000:2.0:1783969207.100862:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099181440 00000100:00100000:2.0:1783969207.100913:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099181568 00000100:00100000:2.0:1783969207.100917:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099181568 00000100:00100000:2.0:1783969207.100928:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099181696 00000100:00100000:2.0:1783969207.100932:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099181696 00000100:00100000:2.0:1783969207.100939:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099181824 00000100:00100000:2.0:1783969207.100941:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099181824 00000100:00100000:2.0:1783969207.100954:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783969207.100964:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:10399:x1870627099181440:12345-0@lo:104: 00000100:00100000:0.0:1783969207.101017:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969207.101030:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:10399:x1870627099181568:12345-0@lo:104: 00000100:00100000:3.0:1783969207.104271:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181312:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969207.104322:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104461:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969207.104472:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbffb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:10399:x1870627099181568:12345-0@lo:104: Request processed in 3443us (3911us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969207.104483:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969207.104526:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783969207.104536:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:10399:x1870627099181696:12345-0@lo:104: 00010000:00010000:0.0:1783969207.104549:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104602:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969207.104608:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:10399:x1870627099181696:12345-0@lo:104: Request processed in 75us (3792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969207.104615:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783969207.104628:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783969207.104634:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:10399:x1870627099181824:12345-0@lo:104: 00010000:00010000:0.0:1783969207.104641:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104674:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783969207.104679:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:10399:x1870627099181824:12345-0@lo:104: Request processed in 46us (3835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969207.104685:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1783969207.104709:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783969207.104715:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104723:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176400 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969207.104727:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104736:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969207.104744:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969207.104751:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969207.104791:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104797:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969207.104816:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104823:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eac2176400/0xea31253a47cb9865 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb986c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104838:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969207.104842:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104850:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80030c00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969207.104853:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104861:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969207.104868:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969207.104873:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969207.104885:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104891:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969207.104898:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104915:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea80030c00/0xea31253a47cb9811 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9818 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104932:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969207.104936:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104944:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2177600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969207.104948:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104956:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969207.104964:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969207.104971:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969207.104985:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.104991:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969207.105009:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.105017:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eac2177600/0xea31253a47cb9803 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb980a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.105037:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969207.105045:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969207.105047:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969207.105095:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099181952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969207.105109:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181568:0@lo:104: 00010000:00010000:1.0:1783969207.105173:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969207.107507:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181696:0@lo:104: 00000100:00100000:3.0:1783969207.107531:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181824:0@lo:104: 00010000:00010000:2.0:1783969207.108128:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969207.108261:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783969207.108284:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:10399:x1870627099181440:12345-0@lo:104: Request processed in 7319us (7823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969207.108301:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1783969207.108437:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969207.108444:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969207.108453:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdfa00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969207.108457:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969207.108467:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969207.108485:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969207.108491:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783969207.108535:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969207.109244:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1870627099181440:0@lo:104: 00010000:00010000:3.0:1783969207.109307:0:10399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969207.109507:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099182208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969207.109597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969207.109602:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969207.109625:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969207.109634:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb998b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9992 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969207.109669:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969207.109671:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969207.109673:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969207.109682:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969207.109693:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099182336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969207.109712:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099182080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969207.109724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969207.109777:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969207.109781:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099182208 00000100:00100000:3.0:1783969207.109791:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099182208 00010000:00010000:3.0:1783969207.109835:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea80031000/0xea31253a47cb980a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9803 expref: 24 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969207.109852:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099182336 00000100:00100000:2.0:1783969207.109861:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099182336 00000100:00100000:3.0:1783969207.109876:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099182080 00000100:00100000:3.0:1783969207.109882:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099182080 00010000:00010000:2.0:1783969207.109899:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb998b expref: 26 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.109906:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9811 expref: 26 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969207.109946:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783969207.109957:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+26:3646:x1870627099182208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969207.109972:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969207.109979:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea80031000/0xea31253a47cb980a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9803 expref: 26 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969207.109989:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea80031000/0xea31253a47cb980a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9803 expref: 26 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969207.110018:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea80031000/0xea31253a47cb980a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9803 expref: 26 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969207.110033:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969207.110081:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:3646:x1870627099182208:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969207.114003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969207.114078:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099181952 00000100:00100000:0.0:1783969207.114098:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099181952 00010000:00010000:0.0:1783969207.114202:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9865 expref: 26 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969207.115247:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969207.115304:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073956864 00000100:00100000:1.0:1783969207.115322:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073956864 00010000:00010000:1.0:1783969207.115362:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036db expref: 10 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969207.115570:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783969207.115589:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+26:3646:x1870627099182336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969207.115610:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969207.115619:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb998b expref: 26 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.115632:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb998b expref: 26 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.115667:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797800/0xea31253a47cb9992 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb998b expref: 26 pid: 6514 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.115688:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969207.115766:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:3646:x1870627099182336:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (6043us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.115775:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783969207.115807:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783969207.115814:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099182080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969207.115822:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969207.115828:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9811 expref: 24 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.115835:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9811 expref: 24 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.115845:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b600200/0xea31253a47cb9818 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9811 expref: 24 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.115855:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969207.115894:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:3649:x1870627099182080:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (6119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.115900:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:3.0:1783969207.116570:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969207.116622:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099182336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969207.116637:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099182208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969207.117352:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:1.0:1783969207.117372:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073956864:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969207.117690:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969207.117702:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036db expref: 10 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969207.117721:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036db expref: 10 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969207.117741:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b600800/0xea31253a47cb9aaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036db expref: 10 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969207.117757:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969207.117857:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:2391:x1870627073956864:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 493us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969207.117866:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:1.0:1783969207.118073:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099182080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969207.121430:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783969207.125305:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783969207.125328:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2119c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3648:x1870627099181952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969207.125348:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969207.125358:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9865 expref: 21 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125374:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9865 expref: 21 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125413:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb986c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9865 expref: 21 pid: 6515 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125432:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125441:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125460:0:7929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125467:0:7929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125488:0:7929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125497:0:7929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125503:0:7929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969207.125507:0:7929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125516:0:7929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125537:0:7929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969207.125550:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969207.125631:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2119c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3648:x1870627099181952:12345-0@lo:103:ldlm_bl.0 Request processed in 314us (11635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969207.125640:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783969207.125723:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099181952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969207.126533:0:10399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.126550:0:10399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969207.126558:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b6e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969207.155725:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099182720:0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.155817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969207.155865:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099183232:0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.155888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969207.155910:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099183744:0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.155930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969207.155957:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783969207.155963:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099182848:0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.155992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969207.156012:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099183360:0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.156034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969207.156049:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099183872:0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.156073:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969207.156109:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099182720 00000100:00100000:3.0:1783969207.156117:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099182720 00000100:00100000:3.0:1783969207.156169:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099183232 00000100:00100000:3.0:1783969207.156172:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099183232 00000100:00100000:3.0:1783969207.156198:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099183744 00000100:00100000:3.0:1783969207.156200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099183744 00000100:00100000:3.0:1783969207.156211:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099183360 00000100:00100000:3.0:1783969207.156214:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099183360 00000100:00100000:3.0:1783969207.156226:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099183872 00000100:00100000:3.0:1783969207.156229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099183872 00000100:00100000:3.0:1783969207.156290:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783969207.156299:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099182720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.156595:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099182720:12345-0@lo:400:kworker.0 Request processed in 294us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.156620:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783969207.156653:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783969207.156660:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099183232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.156692:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099183232:12345-0@lo:400:kworker.0 Request processed in 33us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.156699:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783969207.156710:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783969207.156717:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099183744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.156743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099183744:12345-0@lo:400:kworker.0 Request processed in 28us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.156749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783969207.156760:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783969207.156766:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099183360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.156793:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099183360:12345-0@lo:400:kworker.0 Request processed in 27us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.156799:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783969207.156809:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783969207.156814:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099183872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.156839:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099183872:12345-0@lo:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.156845:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783969207.156867:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099182848 00000100:00100000:3.0:1783969207.156871:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099182848 00000100:00100000:3.0:1783969207.156899:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783969207.156905:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099182848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.156947:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099182848:12345-0@lo:400:kworker.0 Request processed in 42us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.156954:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783969207.157006:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099182848:0@lo:400:kworker.0 00010000:00080000:3.0:1783969207.157023:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6680 x1870627099183360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969207.157035:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099183360:0@lo:400:kworker.0 00010000:00080000:3.0:1783969207.157045:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff4a80 x1870627099183872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969207.157055:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099183872:0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.157066:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099182720:0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.157076:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099183232:0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.157085:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099183744:0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.157521:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099182592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969207.157589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969207.157633:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099183104:0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.157671:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969207.157692:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099183616:0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.157717:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969207.157736:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099184128:0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.157757:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969207.157776:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1783969207.157782:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099182464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969207.157803:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969207.157821:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099182976:0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.157844:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969207.157862:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099183488:0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.157885:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969207.157902:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099184000:0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.157922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969207.157953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099182976 00000100:00100000:1.0:1783969207.157958:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099182976 00000100:00100000:1.0:1783969207.158004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783969207.158012:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099182976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.158055:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099182976:12345-0@lo:400:kworker.0 Request processed in 44us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969207.158062:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1783969207.158091:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969207.158096:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969207.158107:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099183616 00000100:00100000:1.0:1783969207.158110:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099183616 00000100:00100000:1.0:1783969207.158136:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099184128 00000100:00100000:1.0:1783969207.158139:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099184128 00000100:00100000:1.0:1783969207.158152:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099183488 00000100:00100000:1.0:1783969207.158155:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099183488 00000100:00100000:1.0:1783969207.158166:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099184000 00000100:00100000:1.0:1783969207.158169:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099184000 00000100:00100000:1.0:1783969207.158184:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969207.158190:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099183616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.158222:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099183616:12345-0@lo:400:kworker.0 Request processed in 32us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969207.158229:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969207.158254:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783969207.158271:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099184128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.158299:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099184128:12345-0@lo:400:kworker.0 Request processed in 39us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969207.158305:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969207.158921:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099182592 00000100:00100000:3.0:1783969207.158927:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099182592 00000100:00100000:3.0:1783969207.158965:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099182464 00000100:00100000:3.0:1783969207.158968:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099182464 00000100:00100000:3.0:1783969207.158982:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969207.158988:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1870627099182592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783969207.159015:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969207.159059:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1870627099182592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.159066:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969207.159094:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969207.159100:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099182464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969207.159111:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969207.159134:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099182464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.159140:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783969207.161066:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969207.161103:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099183488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969207.161207:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099183488:12345-0@lo:400:kworker.0 Request processed in 122us (3320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969207.162298:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783969207.166543:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969207.166582:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099184000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.166726:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099184000:12345-0@lo:400:kworker.0 Request processed in 166us (8803us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.166735:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969207.166801:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099183104 00000100:00100000:3.0:1783969207.166811:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099183104 00000100:00100000:3.0:1783969207.166868:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783969207.166875:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099183104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969207.166914:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099183104:12345-0@lo:400:kworker.0 Request processed in 39us (9242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.166920:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1783969207.176750:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734f800 x1870627099182464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969207.176785:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099182464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969207.176804:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099182976:0@lo:400:kworker.0 00010000:00080000:1.0:1783969207.176818:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff4380 x1870627099183488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969207.176827:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099183488:0@lo:400:kworker.0 00010000:00080000:1.0:1783969207.176841:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff7800 x1870627099184000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969207.176848:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099184000:0@lo:400:kworker.0 00010000:00080000:1.0:1783969207.176860:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734f100 x1870627099182592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969207.176870:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099182592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969207.176883:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099183104:0@lo:400:kworker.0 00010000:00080000:1.0:1783969207.176896:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5500 x1870627099183616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969207.176903:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099183616:0@lo:400:kworker.0 00010000:00080000:1.0:1783969207.176914:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5c00 x1870627099184128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969207.176920:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099184128:0@lo:400:kworker.0 00000100:00080000:1.0:1783969207.176999:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969207.177005:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969207.664850:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099184256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969207.664955:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969207.665059:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099184256 00000100:00100000:2.0:1783969207.665070:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099184256 00000100:00100000:2.0:1783969207.665141:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783969207.665152:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099184256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969207.665191:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969207.665259:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099184256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969207.665284:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1783969207.665336:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e0700 x1870627099184256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969207.665358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099184256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969207.665765:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969207.665776:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099184384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969207.665808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969207.667813:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099184384 00000100:00100000:3.0:1783969207.668046:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099184384 00000100:00100000:3.0:1783969207.668191:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783969207.668203:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099184384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969207.668244:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969207.668354:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099184384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969207.668410:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1783969207.671636:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff1c00 x1870627099184384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969207.671677:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099184384:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783969208.129605:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969208.341962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969208.342071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073956992 00000100:00100000:3.0:1783969208.342084:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073956992 00000100:00100000:3.0:1783969208.342160:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 252 00000100:00100000:3.0:1783969208.342174:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:6166:x1870627073956992:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969208.342199:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969208.342239:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303721 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.342291:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303721 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.342312:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303721 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.342324:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796600, rc 0) 00000100:00100000:3.0:1783969208.342440:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6166:x1870627073956992:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 269us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.342448:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 252 00000100:00100000:3.0:1783969208.363124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969208.363242:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073957120 00000100:00100000:0.0:1783969208.363256:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073957120 00000100:00100000:0.0:1783969208.363335:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 253 00000100:00100000:0.0:1783969208.363348:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6166:x1870627073957120:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969208.363597:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6166:x1870627073957120:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 251us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969208.363606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 253 00000100:00100000:2.0:1783969208.371135:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969208.371232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073957248 00000100:00100000:1.0:1783969208.371247:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073957248 00000100:00100000:1.0:1783969208.371335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 254 00000100:00100000:1.0:1783969208.371349:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6166:x1870627073957248:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969208.371573:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6166:x1870627073957248:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 227us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969208.371582:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 254 00000100:00100000:3.0:1783969208.374865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969208.374959:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073957376 00000100:00100000:1.0:1783969208.374981:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073957376 00000100:00100000:1.0:1783969208.375051:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 255 00000100:00100000:1.0:1783969208.375063:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6704:x1870627073957376:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783969208.375275:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6704:x1870627073957376:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 213us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969208.375285:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 255 00000100:00100000:3.0:1783969208.384229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969208.384425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073957504 00000100:00100000:2.0:1783969208.384437:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073957504 00000100:00100000:2.0:1783969208.384508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 256 00000100:00100000:2.0:1783969208.384521:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6704:x1870627073957504:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969208.384724:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:6704:x1870627073957504:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 205us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969208.384734:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 256 10000000:01000000:0.0:1783969208.435081:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783969208.435092:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e98212a000 from 4 10000000:01000000:0.0:1783969208.435099:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969208.435168:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969208.435182:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969208.435195:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969208.435243:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099184512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969208.435364:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969208.435453:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.435536:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099184512 00000100:00100000:3.0:1783969208.435546:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099184512 00000100:00100000:3.0:1783969208.435617:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783969208.435629:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099184512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969208.435645:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969208.435679:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9b7c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.435709:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9b7c expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.435721:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b7c expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.435732:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797a00, rc 0) 00000100:00100000:3.0:1783969208.435785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099184512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.435792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1783969208.436356:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099184512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969208.436398:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969208.436410:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969208.436506:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099184640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969208.436562:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969208.436595:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969208.436614:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099184640 00000100:00100000:1.0:1783969208.436618:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099184640 00000100:00100000:1.0:1783969208.436650:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783969208.436658:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099184640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969208.436841:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099184640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969208.436850:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783969208.436982:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099184640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969208.437014:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099184768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969208.437060:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969208.437073:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969208.437085:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099184768 00000100:00100000:1.0:1783969208.437089:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099184768 00000100:00100000:1.0:1783969208.437108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783969208.437114:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099184768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969208.437197:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099184768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969208.437205:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783969208.437264:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099184768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969208.439657:0:10431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10431:1870627099184896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969208.440145:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969208.440207:0:10431:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9834193c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969208.440317:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099184896 00000100:00100000:0.0:1783969208.440326:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099184896 00000100:00100000:0.0:1783969208.440571:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783969208.440584:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:10431:x1870627099184896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969208.440919:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:10431:x1870627099184896:12345-0@lo:502:llog_process_th.0 Request processed in 337us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969208.440927:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783969208.448604:0:10431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10431:1870627099184896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969208.450426:0:10431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969208.450450:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969208.450453:0:10431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783969208.450473:0:10431:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93e98212a000 00000020:00000080:0.0:1783969208.450476:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783969208.450606:0:10431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10431:1870627099185024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969208.450736:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969208.450855:0:10431:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.451220:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099185024 00000100:00100000:3.0:1783969208.451229:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099185024 00000100:00100000:3.0:1783969208.451312:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783969208.451324:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:10431:x1870627099185024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969208.451506:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:10431:x1870627099185024:12345-0@lo:502:llog_process_th.0 Request processed in 184us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.451515:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783969208.454913:0:10431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10431:1870627099185024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969208.454970:0:10431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969208.454980:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969208.454983:0:10431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783969208.454990:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783969208.455096:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783969208.455245:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969208.455260:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969208.455273:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969208.455285:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783969208.455568:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab70d7000 from 4 10000000:01000000:0.0:1783969208.455573:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969208.455617:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969208.455627:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969208.455638:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969208.455666:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969208.455750:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969208.456038:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969208.456977:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099185152 00000100:00100000:0.0:1783969208.456988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099185152 00000100:00100000:0.0:1783969208.457051:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783969208.457063:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099185152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969208.457083:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969208.457103:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9b8a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969208.457145:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9b8a expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969208.457159:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b8a expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969208.457168:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde400, rc 0) 00000100:00100000:0.0:1783969208.457242:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099185152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969208.457249:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783969208.457321:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969208.457339:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969208.457639:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969208.457725:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969208.457925:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969208.457956:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969208.457974:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099185280 00000100:00100000:0.0:1783969208.457977:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099185280 00000100:00100000:0.0:1783969208.458013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783969208.458020:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099185280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969208.458159:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099185280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969208.458166:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783969208.458197:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969208.458237:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969208.458281:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969208.458304:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7285e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969208.458316:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099185408 00000100:00100000:0.0:1783969208.458319:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099185408 00000100:00100000:3.0:1783969208.458373:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783969208.458404:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099185408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.458504:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099185408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.458511:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783969208.458553:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.458791:0:10434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10434:1870627099185536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969208.458825:0:10434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.458845:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099185536 00000100:00100000:3.0:1783969208.458848:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099185536 00000100:00100000:3.0:1783969208.458868:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783969208.458873:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:10434:x1870627099185536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969208.458943:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:10434:x1870627099185536:12345-0@lo:502:llog_process_th.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.458950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783969208.458977:0:10434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.458990:0:10434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10434:1870627099185536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969208.459013:0:10434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969208.459024:0:10434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969208.459027:0:10434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783969208.459035:0:10434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93eab70d7000 00000020:00000080:3.0:1783969208.459037:0:10434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783969208.459131:0:10434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10434:1870627099185664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969208.459166:0:10434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.459184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099185664 00000100:00100000:3.0:1783969208.459188:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099185664 00000100:00100000:3.0:1783969208.459205:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783969208.459225:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:10434:x1870627099185664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969208.459299:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:10434:x1870627099185664:12345-0@lo:502:llog_process_th.0 Request processed in 87us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.459307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783969208.459334:0:10434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.459352:0:10434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10434:1870627099185664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969208.459370:0:10434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969208.459375:0:10434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969208.459377:0:10434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783969208.459407:0:10434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783969208.459477:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783969208.459500:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969208.459511:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.459521:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969208.459532:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969208.459535:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab929d800 from 4 10000000:01000000:3.0:1783969208.459537:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969208.459564:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.459571:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.459581:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969208.459593:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.459622:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.459635:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.459647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099185792 00000100:00100000:3.0:1783969208.459650:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099185792 00000100:00100000:3.0:1783969208.459674:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783969208.459679:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099185792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969208.459688:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969208.459702:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9b98 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.459724:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9b98 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.459734:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b98 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.459743:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796c00, rc 0) 00000100:00100000:3.0:1783969208.459771:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099185792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.459777:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783969208.459805:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969208.459817:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.459826:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969208.459868:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.459893:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.459904:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.459914:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099185920 00000100:00100000:3.0:1783969208.459918:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099185920 00000100:00100000:3.0:1783969208.459941:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783969208.459946:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099185920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.460030:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099185920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.460037:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783969208.460063:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099185920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.460087:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099186048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.460120:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.460133:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.460144:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099186048 00000100:00100000:3.0:1783969208.460148:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099186048 00000100:00100000:3.0:1783969208.460165:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783969208.460171:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099186048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.460253:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099186048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.460260:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783969208.460296:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099186048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969208.463752:0:10435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10435:1870627099186176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969208.465664:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969208.466161:0:10435:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab72856c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.466415:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099186176 00000100:00100000:3.0:1783969208.466426:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099186176 00000100:00100000:3.0:1783969208.466491:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783969208.466504:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:10435:x1870627099186176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969208.466692:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:10435:x1870627099186176:12345-0@lo:502:llog_process_th.0 Request processed in 190us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.466700:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783969208.467175:0:10435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10435:1870627099186176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969208.467226:0:10435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969208.467238:0:10435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969208.467240:0:10435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783969208.467248:0:10435:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93eab929d800 00000020:00000080:0.0:1783969208.467251:0:10435:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783969208.469688:0:10435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10435:1870627099186304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969208.470217:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969208.470282:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099186304 00000100:00100000:0.0:1783969208.470289:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099186304 00000100:00100000:0.0:1783969208.470366:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1783969208.470376:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:10435:x1870627099186304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969208.470600:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:10435:x1870627099186304:12345-0@lo:502:llog_process_th.0 Request processed in 223us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969208.470607:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1783969208.470666:0:10435:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab72856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969208.470700:0:10435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10435:1870627099186304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969208.470730:0:10435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969208.470738:0:10435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969208.470740:0:10435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783969208.470746:0:10435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783969208.471172:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783969208.471220:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969208.471233:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.471246:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969208.471257:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969208.471260:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ea912c9800 from 4 10000000:01000000:3.0:1783969208.471263:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969208.471308:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.471316:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.471325:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969208.471345:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099186432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.471402:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.471426:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.471442:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099186432 00000100:00100000:3.0:1783969208.471446:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099186432 00000100:00100000:3.0:1783969208.471474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783969208.471481:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099186432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969208.471493:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969208.471509:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9ba6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.471548:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9ba6 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.471559:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9ba6 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.471570:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797e00, rc 0) 00000100:00100000:3.0:1783969208.471600:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099186432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.471607:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783969208.471644:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099186432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969208.471658:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969208.471668:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969208.471725:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099186560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.471751:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.471777:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.471791:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099186560 00000100:00100000:3.0:1783969208.471795:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099186560 00000100:00100000:3.0:1783969208.471819:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783969208.471826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099186560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.471932:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099186560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.471950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1783969208.471982:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099186560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.472010:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099186688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.472047:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.472061:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.472073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099186688 00000100:00100000:3.0:1783969208.472076:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099186688 00000100:00100000:3.0:1783969208.472096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783969208.472102:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099186688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.472177:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099186688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.472184:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783969208.472234:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099186688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969208.472467:0:10437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10437:1870627099186816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969208.472500:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.472519:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099186816 00000100:00100000:3.0:1783969208.472522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099186816 00000100:00100000:3.0:1783969208.472546:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1783969208.472552:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:10437:x1870627099186816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969208.472616:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:10437:x1870627099186816:12345-0@lo:502:llog_process_th.0 Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969208.472623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1783969208.472655:0:10437:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969208.472666:0:10437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10437:1870627099186816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969208.472694:0:10437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969208.472704:0:10437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969208.472707:0:10437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783969208.472715:0:10437:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ea912c9800 00000020:00000080:3.0:1783969208.472718:0:10437:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783969208.472806:0:10437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10437:1870627099186944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969208.472838:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969208.472853:0:10437:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969208.475130:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099186944 00000100:00100000:0.0:1783969208.475144:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099186944 00000100:00100000:0.0:1783969208.475219:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1783969208.475231:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:10437:x1870627099186944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969208.475469:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:10437:x1870627099186944:12345-0@lo:502:llog_process_th.0 Request processed in 240us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969208.475477:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1783969208.475854:0:10437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:10437:1870627099186944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969208.475909:0:10437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969208.475919:0:10437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969208.475922:0:10437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783969208.475928:0:10437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783969208.476104:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783969208.476132:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969208.476145:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969208.476157:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969209.139788:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969210.163603:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969211.192923:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969211.257567:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099187072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969211.257648:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969211.257879:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099187072 00000100:00100000:3.0:1783969211.257888:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099187072 00000100:00100000:3.0:1783969211.257938:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783969211.257948:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099187072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969211.257985:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783969211.259669:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099187072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1714us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969211.259683:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783969211.262035:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099187072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969211.760568:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969211.760595:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099187200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969211.760672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969211.761006:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099187200 00000100:00100000:2.0:1783969211.761014:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099187200 00000100:00100000:2.0:1783969211.761073:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783969211.761083:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099187200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969211.761119:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969211.761301:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099187200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 220us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969211.761309:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783969211.761441:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099187200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969212.173539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969212.173587:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969212.173619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969212.173637:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969212.173663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969212.173706:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073957888 00000100:00100000:2.0:1783969212.173718:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073957888 00000100:00100000:2.0:1783969212.173794:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073957760 00000100:00100000:2.0:1783969212.173797:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073957760 00000100:00100000:2.0:1783969212.173817:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1783969212.173828:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073957888:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969212.173924:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073957888:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969212.173933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1783969212.173958:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:2.0:1783969212.173965:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073957760:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969212.174006:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073957760:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 42us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969212.174013:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00080000:1.0:1783969212.177452:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969212.177485:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969212.179612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073957632 00000100:00100000:3.0:1783969212.179634:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073957632 00000100:00100000:3.0:1783969212.179736:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 277 00000100:00100000:3.0:1783969212.179748:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073957632:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969212.179862:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073957632:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 117us (6338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.179870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 277 00000100:00100000:3.0:1783969212.179914:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073958144 00000100:00100000:3.0:1783969212.179918:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073958144 00000100:00100000:3.0:1783969212.179955:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073958016 00000100:00100000:3.0:1783969212.179958:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073958016 00000100:00100000:3.0:1783969212.179977:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1783969212.179983:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073958144:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969212.180010:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073958144:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (6390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.180016:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1783969212.180026:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1783969212.180031:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073958016:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969212.180051:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073958016:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 20us (6388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.180056:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00080000:3.0:1783969212.180244:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969212.180248:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783969212.211721:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969212.281796:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099187328:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.281902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.281968:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099187840:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.282004:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.282027:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099188352:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.282052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.282084:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099188864:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.282106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.282134:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783969212.282139:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099187456:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.282200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.282222:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099187968:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.282244:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.282269:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099188480:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.282288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.282318:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099187584:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.282340:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.282358:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099188096:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.282377:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.288326:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099188608:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.288430:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.288475:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099189120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969212.288504:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.288534:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783969212.288541:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099187712:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.288564:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.288577:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099188224:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.288632:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.288653:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099188736:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.288675:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.288746:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099187328 00000100:00100000:3.0:1783969212.288755:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099187328 00000100:00100000:3.0:1783969212.288819:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783969212.288831:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099187328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.288892:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099187328:12345-0@lo:400:kworker.0 Request processed in 63us (6991us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.288901:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783969212.288944:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099187840 00000100:00100000:3.0:1783969212.288948:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099187840 00000100:00100000:3.0:1783969212.288970:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099187584 00000100:00100000:3.0:1783969212.288972:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099187584 00000100:00100000:3.0:1783969212.288985:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783969212.288991:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099187840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289028:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099187840:12345-0@lo:400:kworker.0 Request processed in 37us (7024us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289033:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783969212.289044:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783969212.289049:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099187584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289085:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099187584:12345-0@lo:400:kworker.0 Request processed in 35us (6743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289091:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783969212.289109:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099188352 00000100:00100000:3.0:1783969212.289113:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099188352 00000100:00100000:3.0:1783969212.289142:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099188864 00000100:00100000:3.0:1783969212.289145:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099188864 00000100:00100000:3.0:1783969212.289173:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099188224 00000100:00100000:3.0:1783969212.289176:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099188224 00000100:00100000:3.0:1783969212.289189:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099188736 00000100:00100000:3.0:1783969212.289192:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099188736 00000100:00100000:3.0:1783969212.289217:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969212.289224:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099188352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289259:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099188352:12345-0@lo:400:kworker.0 Request processed in 36us (7206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289265:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969212.289277:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969212.289282:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099188864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289309:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099188864:12345-0@lo:400:kworker.0 Request processed in 27us (7202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289314:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969212.289325:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783969212.289330:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099188224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289357:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099188224:12345-0@lo:400:kworker.0 Request processed in 27us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289362:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783969212.289372:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783969212.289377:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099188736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289439:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099188736:12345-0@lo:400:kworker.0 Request processed in 61us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289445:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783969212.289471:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099187456 00000100:00100000:3.0:1783969212.289476:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099187456 00000100:00100000:3.0:1783969212.289496:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099187968 00000100:00100000:3.0:1783969212.289499:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099187968 00000100:00100000:3.0:1783969212.289512:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099188480 00000100:00100000:3.0:1783969212.289515:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099188480 00000100:00100000:3.0:1783969212.289526:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099188096 00000100:00100000:3.0:1783969212.289536:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099188096 00000100:00100000:3.0:1783969212.289552:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099188608 00000100:00100000:3.0:1783969212.289554:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099188608 00000100:00100000:3.0:1783969212.289565:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099187712 00000100:00100000:3.0:1783969212.289568:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099187712 00000100:00100000:3.0:1783969212.289582:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783969212.289587:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099187456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289619:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099187456:12345-0@lo:400:kworker.0 Request processed in 32us (7418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289626:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783969212.289637:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783969212.289642:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099187968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289671:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099187968:12345-0@lo:400:kworker.0 Request processed in 29us (7426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289677:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783969212.289688:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783969212.289694:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099188480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289734:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099188480:12345-0@lo:400:kworker.0 Request processed in 41us (7445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289739:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783969212.289750:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783969212.289756:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099188096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289794:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099188096:12345-0@lo:400:kworker.0 Request processed in 30us (7406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289800:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783969212.289809:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783969212.289814:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099188608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289850:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099188608:12345-0@lo:400:kworker.0 Request processed in 35us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289856:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783969212.289867:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783969212.289873:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099187712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.289918:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099187712:12345-0@lo:400:kworker.0 Request processed in 43us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.289924:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783969212.289962:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099189120 00000100:00100000:3.0:1783969212.289966:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099189120 00000100:00100000:3.0:1783969212.290001:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783969212.290007:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099189120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969212.290034:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969212.290071:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099189120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969212.290077:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1783969212.290110:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969212.290115:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969212.290117:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969212.290119:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969212.290140:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099188992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969212.294606:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099187456:0@lo:400:kworker.0 00000100:00100000:0.0:1783969212.294646:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099187968:0@lo:400:kworker.0 00000100:00100000:0.0:1783969212.294661:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099188480:0@lo:400:kworker.0 00000100:00100000:0.0:1783969212.294674:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099187328:0@lo:400:kworker.0 00000100:00100000:0.0:1783969212.294688:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099187840:0@lo:400:kworker.0 00010000:00080000:0.0:1783969212.294706:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff4e00 x1870627099188352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969212.294718:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099188352:0@lo:400:kworker.0 00010000:00080000:0.0:1783969212.294739:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e6a00 x1870627099188864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969212.294748:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099188864:0@lo:400:kworker.0 00000100:00100000:3.0:1783969212.296777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969212.296903:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099187712:0@lo:400:kworker.0 00010000:00080000:3.0:1783969212.296926:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5f80 x1870627099188224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969212.296937:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099188224:0@lo:400:kworker.0 00010000:00080000:3.0:1783969212.296970:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6300 x1870627099188736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969212.296979:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099188736:0@lo:400:kworker.0 00010000:00080000:3.0:1783969212.296992:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734f100 x1870627099189120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969212.297011:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099189120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969212.297026:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099187584:0@lo:400:kworker.0 00010000:00080000:3.0:1783969212.297039:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6d80 x1870627099188096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969212.297047:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099188096:0@lo:400:kworker.0 00010000:00080000:3.0:1783969212.297059:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6680 x1870627099188608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969212.297068:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099188608:0@lo:400:kworker.0 00000100:00100000:0.0:1783969212.297193:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099188992 00000100:00100000:0.0:1783969212.297203:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099188992 00000100:00100000:0.0:1783969212.297268:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783969212.297280:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099188992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969212.297312:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969212.297374:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099188992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969212.297410:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1783969212.300604:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734f800 x1870627099188992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969212.300642:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099188992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969212.785102:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969212.785136:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099189248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969212.785243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969212.785486:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099189376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969212.785526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969212.785570:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099189248 00000100:00100000:0.0:1783969212.785579:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099189248 00000100:00100000:0.0:1783969212.785631:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099189376 00000100:00100000:0.0:1783969212.785634:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099189376 00000100:00100000:0.0:1783969212.785997:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969212.786008:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099189248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969212.786046:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969212.786113:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099189248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969212.786120:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969212.786149:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783969212.786156:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099189376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969212.786166:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969212.786195:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099189376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969212.786200:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1783969212.786256:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff1500 x1870627099189376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969212.786279:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099189376:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783969212.793404:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319ce00 x1870627099189248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969212.793450:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099189248:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1783969213.116250:0:10698:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1783969213.232819:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969214.256773:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969215.291683:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969216.306860:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969216.373365:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099189504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969216.373471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969216.376539:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099189504 00000100:00100000:1.0:1783969216.376555:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099189504 00000100:00100000:1.0:1783969216.376615:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783969216.376626:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099189504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969216.376666:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969216.383328:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099189504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6693us (9847us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969216.383342:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783969216.383635:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099189504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969216.880817:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969216.880854:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099189632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969216.880962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969216.881186:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099189632 00000100:00100000:0.0:1783969216.881207:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099189632 00000100:00100000:0.0:1783969216.881278:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783969216.881290:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099189632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783969216.881343:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783969216.881439:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099189632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969216.881448:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783969216.881565:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099189632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969217.301518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969217.301574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969217.301609:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969217.301649:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073958528 00000100:00100000:0.0:1783969217.301660:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073958528 00000100:00100000:0.0:1783969217.301732:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073958400 00000100:00100000:0.0:1783969217.301735:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073958400 00000100:00100000:0.0:1783969217.301760:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1783969217.301772:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073958528:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969217.301867:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073958528:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 97us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969217.301874:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1783969217.301893:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:0.0:1783969217.301899:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2394:x1870627073958400:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969217.301924:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2394:x1870627073958400:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969217.301931:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00080000:0.0:1783969217.301949:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969217.301954:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969217.302614:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073958272 00000100:00100000:2.0:1783969217.302621:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073958272 00000100:00100000:2.0:1783969217.302676:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 279 00000100:00100000:2.0:1783969217.302684:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2394:x1870627073958272:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969217.302723:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2394:x1870627073958272:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969217.302729:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 279 00000100:00100000:2.0:1783969217.307712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969217.307779:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969217.307882:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073958656 00000100:00100000:0.0:1783969217.307882:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073958784 00000100:00100000:1.0:1783969217.307895:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073958656 00000100:00100000:0.0:1783969217.307898:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073958784 00000100:00080000:2.0:1783969217.307978:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969217.307983:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969217.307986:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1783969217.307998:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2390:x1870627073958656:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:1.0:1783969217.308049:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9abf 00000100:00080000:1.0:1783969217.308062:0:8437:0:(import.c:65:import_set_state_nolock()) ffff93eab9fc4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783969217.308144:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783969217.308350:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+2:2390:x1870627073958656:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 354us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969217.308359:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00010000:00010000:2.0:1783969217.308413:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969217.309393:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1783969217.309414:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab770a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2390:x1870627073958784:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:0.0:1783969217.309456:0:9974:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9ac6 00000100:00080000:0.0:1783969217.309468:0:9974:0:(import.c:65:import_set_state_nolock()) ffff93eaac722800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783969217.309521:0:9974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1783969217.309677:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab770a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+2:2390:x1870627073958784:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 272us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969217.309685:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00010000:00010000:2.0:1783969217.318097:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969217.329690:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969217.393561:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099189760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969217.393573:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969217.393590:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099189888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969217.393921:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969217.394024:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099189760 00000100:00100000:3.0:1783969217.394034:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099189760 00000100:00100000:3.0:1783969217.394120:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783969217.394133:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099189760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969217.394173:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969217.394228:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099189760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969217.394236:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1783969217.394260:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783969217.395006:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983712680 x1870627099189760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969217.395033:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099189760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969217.395482:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099190400:0@lo:400:kworker.0 00000100:00100000:1.0:1783969217.395515:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969217.395532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969217.395568:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099190912:0@lo:400:kworker.0 00000100:00100000:1.0:1783969217.395571:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099190016:0@lo:400:kworker.0 00000100:00100000:3.0:1783969217.395593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969217.395599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969217.395618:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099190528:0@lo:400:kworker.0 00000100:00100000:3.0:1783969217.395627:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099190400 00000100:00100000:3.0:1783969217.395631:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099190400 00000100:00100000:1.0:1783969217.395638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969217.395656:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099191040:0@lo:400:kworker.0 00000100:00100000:3.0:1783969217.395672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099190528 00000100:00100000:1.0:1783969217.395673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969217.395674:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099190528 00000100:00100000:3.0:1783969217.395699:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099191040 00000100:00100000:3.0:1783969217.395702:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099191040 00000100:00100000:1.0:1783969217.395704:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783969217.395713:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099190400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969217.395715:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783969217.395719:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099190528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969217.395762:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099190528:12345-0@lo:400:kworker.0 Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969217.395762:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099190400:12345-0@lo:400:kworker.0 Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969217.395770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783969217.395800:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099189888 00000100:00100000:2.0:1783969217.395803:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099189888 00000100:00100000:2.0:1783969217.395838:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783969217.395845:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099189888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783969217.395862:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969217.395901:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099189888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969217.395907:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783969217.395951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099190016 00000100:00100000:2.0:1783969217.395955:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099190016 00000100:00100000:2.0:1783969217.395981:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783969217.395994:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099190016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.396027:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099190016:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969217.396034:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1783969217.397227:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783969217.397261:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783969217.397274:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099191040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969217.397351:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099191040:12345-0@lo:400:kworker.0 Request processed in 81us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969217.397358:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1783969217.397436:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969217.397442:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969217.397483:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099190400:0@lo:400:kworker.0 00000100:00100000:1.0:1783969217.397526:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099190016:0@lo:400:kworker.0 00000100:00100000:1.0:1783969217.397539:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099190528:0@lo:400:kworker.0 00000100:00100000:1.0:1783969217.397549:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099191040:0@lo:400:kworker.0 00010000:00080000:1.0:1783969217.397565:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734c000 x1870627099189888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969217.397598:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099189888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969217.397878:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099190912 00000100:00100000:2.0:1783969217.397886:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099190912 00000100:00080000:3.0:1783969217.398115:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969217.398202:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783969217.398213:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099190912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.398349:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099190912:12345-0@lo:400:kworker.0 Request processed in 138us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969217.398356:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783969217.398436:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099190144:0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.398481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969217.398512:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099190656:0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.398536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969217.398556:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099191168:0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.398579:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969217.398602:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783969217.398609:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099190272:0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.398636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969217.398656:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099190784:0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.398678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969217.398701:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099191296:0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.398747:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969217.398780:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099190144 00000100:00100000:2.0:1783969217.398790:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099190144 00000100:00100000:2.0:1783969217.398818:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099190656 00000100:00100000:2.0:1783969217.398821:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099190656 00000100:00100000:2.0:1783969217.398839:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099191168 00000100:00100000:2.0:1783969217.398841:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099191168 00000100:00100000:2.0:1783969217.398855:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783969217.398861:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099190144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.398900:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099190144:12345-0@lo:400:kworker.0 Request processed in 39us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969217.398907:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783969217.398919:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783969217.398924:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099190656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.398948:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099190656:12345-0@lo:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969217.398955:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783969217.398972:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783969217.398978:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099191168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.399003:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099191168:12345-0@lo:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969217.399009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783969217.399027:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099190272 00000100:00100000:2.0:1783969217.399030:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099190272 00000100:00100000:2.0:1783969217.399055:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783969217.399075:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099190272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.399110:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099190272:12345-0@lo:400:kworker.0 Request processed in 49us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969217.399752:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099190784 00000100:00100000:0.0:1783969217.399760:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099190784 00000100:00100000:0.0:1783969217.399795:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099191296 00000100:00100000:0.0:1783969217.399798:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099191296 00000100:00100000:0.0:1783969217.399815:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969217.399822:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099190784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969217.399875:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099190784:12345-0@lo:400:kworker.0 Request processed in 53us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969217.399882:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969217.399896:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783969217.399902:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099191296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969217.399926:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099191296:12345-0@lo:400:kworker.0 Request processed in 25us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969217.399932:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783969217.400213:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783969217.400286:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099190272:0@lo:400:kworker.0 00010000:00080000:2.0:1783969217.400304:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319e680 x1870627099190784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969217.400315:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099190784:0@lo:400:kworker.0 00010000:00080000:2.0:1783969217.400326:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319ed80 x1870627099191296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969217.400335:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099191296:0@lo:400:kworker.0 00000100:00100000:2.0:1783969217.400346:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099190144:0@lo:400:kworker.0 00010000:00080000:2.0:1783969217.400357:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319c000 x1870627099190656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969217.400366:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099190656:0@lo:400:kworker.0 00010000:00080000:2.0:1783969217.400376:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319c700 x1870627099191168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969217.400411:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099191168:0@lo:400:kworker.0 00000100:00080000:0.0:1783969217.401255:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783969217.401264:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783969217.401423:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319df80 x1870627099190912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969217.401438:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099190912:0@lo:400:kworker.0 00000100:00100000:0.0:1783969217.904589:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099191424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969217.904693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969217.904788:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099191424 00000100:00100000:0.0:1783969217.904798:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099191424 00000100:00100000:0.0:1783969217.904860:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783969217.904869:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099191424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969217.904908:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969217.904955:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099191424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969217.904962:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1783969217.905021:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff3800 x1870627099191424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969217.905044:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099191424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969217.907488:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969217.907518:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099191552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969217.907605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969217.907667:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099191552 00000100:00100000:0.0:1783969217.907677:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099191552 00000100:00100000:0.0:1783969217.907738:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783969217.907749:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099191552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969217.907779:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969217.907913:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099191552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969217.907922:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1783969217.907983:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff3800 x1870627099191552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969217.908004:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099191552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783969218.355554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969219.377640:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783969219.635530:0:10942:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing yml_node 00010000:00010000:3.0:1783969220.401518:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969221.425965:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969221.488921:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969221.488953:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099191680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969221.489079:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969221.489232:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099191680 00000100:00100000:1.0:1783969221.489243:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099191680 00000100:00100000:1.0:1783969221.489317:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783969221.489331:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099191680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969221.489408:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969221.489476:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099191680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969221.489484:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783969221.489625:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099191680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969222.001771:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099191808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969222.001873:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969222.002057:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099191808 00000100:00100000:1.0:1783969222.002068:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099191808 00000100:00100000:1.0:1783969222.002135:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783969222.002146:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099191808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969222.002204:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969222.002271:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099191808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969222.002280:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783969222.002528:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099191808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969222.421205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969222.421267:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969222.421306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969222.421430:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073958912 00000100:00100000:0.0:1783969222.421444:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073958912 00000100:00100000:0.0:1783969222.421517:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 281 00000100:00100000:0.0:1783969222.421528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073958912:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969222.421633:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073958912:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 107us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969222.421641:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 281 00000100:00100000:1.0:1783969222.422106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073959040 00000100:00100000:1.0:1783969222.422113:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073959040 00000100:00100000:1.0:1783969222.422169:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073959168 00000100:00100000:1.0:1783969222.422173:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073959168 00000100:00100000:1.0:1783969222.422198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:1.0:1783969222.422207:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073959040:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969222.422257:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073959040:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 51us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969222.422285:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:1.0:1783969222.422301:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:1.0:1783969222.422307:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073959168:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969222.422335:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073959168:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969222.422341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00080000:0.0:1783969222.422976:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969222.422993:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783969222.449036:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969222.516870:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969222.516908:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099191936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969222.517024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.517369:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099191936 00000100:00100000:3.0:1783969222.517404:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099191936 00000100:00100000:3.0:1783969222.517522:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969222.517538:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099191936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969222.517584:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969222.517647:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099191936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969222.517656:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1783969222.517748:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783969222.517791:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983710000 x1870627099191936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969222.517814:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099191936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969222.518032:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099192064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969222.518066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518417:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099192576:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518470:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099193088:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518534:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783969222.518540:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099192448:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518583:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099192960:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518625:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099192320:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518649:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518664:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099192832:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518683:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518697:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099193344:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518717:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518732:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783969222.518738:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099192192:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518776:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518798:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099192704:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518821:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518839:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099193216:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.518861:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969222.518883:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099192576 00000100:00100000:3.0:1783969222.518890:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099192576 00000100:00100000:3.0:1783969222.518924:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099192320 00000100:00100000:3.0:1783969222.518927:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099192320 00000100:00100000:3.0:1783969222.518941:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099192832 00000100:00100000:3.0:1783969222.518943:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099192832 00000100:00100000:3.0:1783969222.518961:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099193344 00000100:00100000:3.0:1783969222.518963:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099193344 00000100:00100000:3.0:1783969222.518975:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099192704 00000100:00100000:3.0:1783969222.519015:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099192704 00000100:00100000:3.0:1783969222.519033:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099193216 00000100:00100000:3.0:1783969222.519036:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099193216 00000100:00100000:3.0:1783969222.519052:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783969222.519060:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099192576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.519114:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099192576:12345-0@lo:400:kworker.0 Request processed in 54us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969222.519123:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783969222.519140:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783969222.519145:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099192320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.519587:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783969222.519600:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099192832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.519641:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099192832:12345-0@lo:400:kworker.0 Request processed in 45us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969222.519648:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783969222.519675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783969222.519681:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099193344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.519707:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099193344:12345-0@lo:400:kworker.0 Request processed in 27us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969222.519713:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783969222.519723:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783969222.519729:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099192704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.519767:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099192704:12345-0@lo:400:kworker.0 Request processed in 39us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969222.519773:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783969222.519783:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783969222.519788:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099193216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.519810:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099193216:12345-0@lo:400:kworker.0 Request processed in 22us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969222.519815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783969222.519834:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099193088 00000100:00100000:0.0:1783969222.519839:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099193088 00000100:00100000:0.0:1783969222.519873:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099192960 00000100:00100000:0.0:1783969222.519876:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099192960 00000100:00100000:0.0:1783969222.519893:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783969222.519899:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099193088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.519928:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099193088:12345-0@lo:400:kworker.0 Request processed in 29us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969222.519933:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783969222.519943:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783969222.519948:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099192960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.519974:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099192960:12345-0@lo:400:kworker.0 Request processed in 26us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969222.519979:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1783969222.520227:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf7fb480 x1870627099192960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969222.520244:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099192960:0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.520261:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099192576:0@lo:400:kworker.0 00010000:00080000:0.0:1783969222.520280:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf7fbb80 x1870627099193088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969222.521226:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099193088:0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.521522:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099192704:0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.521536:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099193216:0@lo:400:kworker.0 00000100:00100000:0.0:1783969222.521549:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099192320:0@lo:400:kworker.0 00010000:00080000:0.0:1783969222.521563:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf7f8000 x1870627099192832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969222.521575:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099192832:0@lo:400:kworker.0 00010000:00080000:0.0:1783969222.521586:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf7f9880 x1870627099193344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969222.521595:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099193344:0@lo:400:kworker.0 00000100:00080000:1.0:1783969222.522734:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969222.522745:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969222.522749:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969222.522777:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099192448 00000100:00100000:1.0:1783969222.522787:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099192448 00000100:00100000:1.0:1783969222.522870:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783969222.522882:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099192448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969222.523037:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099192448:12345-0@lo:400:kworker.0 Request processed in 158us (4467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969222.523066:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783969222.523082:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099192064 00000100:00100000:2.0:1783969222.523087:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099192064 00000100:00100000:1.0:1783969222.523116:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099192448:0@lo:400:kworker.0 00000100:00100000:2.0:1783969222.523150:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783969222.523158:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099192064:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969222.523173:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099192192 00002000:00000024:2.0:1783969222.523190:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969222.523192:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099192192 00000100:00100000:1.0:1783969222.523220:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783969222.523226:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099192192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969222.523234:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099192064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (5168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969222.523240:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969222.523263:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099192192:12345-0@lo:400:kworker.0 Request processed in 37us (4486us total) trans 0 rc 0/0 00000100:00080000:2.0:1783969222.523270:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969222.523270:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00080000:1.0:1783969222.523313:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e982421180 x1870627099192064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969222.523333:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099192064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969222.525498:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099192192:0@lo:400:kworker.0 00000100:00100000:3.0:1783969222.528112:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099192320:12345-0@lo:400:kworker.0 Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969222.528134:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783969223.025452:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099193600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969223.025557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969223.025633:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099193600 00000100:00100000:3.0:1783969223.025645:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099193600 00000100:00100000:1.0:1783969223.025651:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969223.025661:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099193472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969223.025690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969223.025725:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099193472 00000100:00100000:3.0:1783969223.025730:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099193472 00000100:00100000:3.0:1783969223.025754:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783969223.025813:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099193600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969223.025857:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969223.025925:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099193600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969223.025934:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783969223.025955:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783969223.025962:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099193472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969223.025986:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969223.026075:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099193472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969223.026090:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1783969223.026427:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff2300 x1870627099193472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969223.026451:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099193472:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1783969223.026465:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8896bb80 x1870627099193600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969223.026487:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099193600:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1783969223.027007:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:3.0:1783969223.027018:0:8432:0:(genops.c:906:class_export_put()) final put ffff93eab9fc3000/c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:2.0:1783969223.027255:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9fc3000/c481ab09-d97e-4adb-b42e-68f98b038d20 for lustre-OST0000 00000020:00000080:2.0:1783969223.027320:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab9fc4000 for lustre-OST0000 00000001:00100000:2.0:1783969223.028909:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:2.0:1783969223.028918:0:9517:0:(genops.c:906:class_export_put()) final put ffff93eab9ee0800/c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:3.0:1783969223.029023:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9ee0800/c481ab09-d97e-4adb-b42e-68f98b038d20 for lustre-OST0001 00000020:00000080:3.0:1783969223.029274:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eaac722800 for lustre-OST0001 00010000:00010000:0.0:1783969223.472523:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783969224.114925:0:11126:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:2.0:1783969224.496554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969225.521247:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969226.545218:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969226.608720:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099193728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969226.608804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969226.609296:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099193728 00000100:00100000:1.0:1783969226.609305:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099193728 00000100:00100000:1.0:1783969226.609363:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783969226.609374:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099193728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969226.609432:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969226.609489:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099193728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969226.609497:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783969226.609586:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099193728:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1783969226.870304:0:11223:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00000100:00100000:0.0:1783969227.122490:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099193856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969227.122565:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969227.122653:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099193856 00000100:00100000:0.0:1783969227.122659:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099193856 00000100:00100000:0.0:1783969227.122704:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783969227.122713:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099193856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783969227.122748:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783969227.122801:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099193856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969227.122809:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783969227.124442:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099193856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969227.549752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969227.549788:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073959296 00000100:00100000:1.0:1783969227.549797:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073959296 00000100:00100000:1.0:1783969227.549849:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 283 00000100:00100000:1.0:1783969227.549858:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2394:x1870627073959296:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969227.549935:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2394:x1870627073959296:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 78us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.549942:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 283 00010000:00010000:2.0:1783969227.568520:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969227.568715:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969227.568754:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969227.574569:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073959424 00000100:00100000:3.0:1783969227.574584:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073959424 00000100:00100000:3.0:1783969227.574660:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073959552 00000100:00100000:3.0:1783969227.574663:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073959552 00000100:00100000:3.0:1783969227.574688:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:3.0:1783969227.574699:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627073959424:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969227.574776:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627073959424:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 80us (6067us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969227.574783:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:3.0:1783969227.574799:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:3.0:1783969227.574805:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073959552:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969227.574824:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073959552:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 19us (6070us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969227.574829:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00080000:3.0:1783969227.576603:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969227.576611:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969227.633239:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099193984:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633355:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099194496:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633429:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099195008:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633477:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783969227.633483:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099194112:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633536:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099194624:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633571:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099195136:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633620:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099194240:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633644:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633660:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099194752:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633677:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633692:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099195264:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633725:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783969227.633729:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099194368:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633754:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099194880:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633767:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633779:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099195392:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633794:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969227.633817:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099193984 00000100:00100000:1.0:1783969227.633824:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099193984 00000100:00100000:1.0:1783969227.633861:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783969227.633868:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099193984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.633924:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099193984:12345-0@lo:400:kworker.0 Request processed in 56us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.633939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783969227.633970:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099194496 00000100:00100000:1.0:1783969227.633974:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099194496 00000100:00100000:1.0:1783969227.633998:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099195008 00000100:00100000:1.0:1783969227.634000:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099195008 00000100:00100000:1.0:1783969227.634009:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099194112 00000100:00100000:1.0:1783969227.634011:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099194112 00000100:00100000:1.0:1783969227.634019:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099194624 00000100:00100000:1.0:1783969227.634020:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099194624 00000100:00100000:1.0:1783969227.634031:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099195136 00000100:00100000:1.0:1783969227.634032:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099195136 00000100:00100000:1.0:1783969227.634040:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099194368 00000100:00100000:1.0:1783969227.634042:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099194368 00000100:00100000:1.0:1783969227.634052:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783969227.634056:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099194496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634085:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099194496:12345-0@lo:400:kworker.0 Request processed in 28us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634090:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783969227.634100:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783969227.634105:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099195008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634124:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099195008:12345-0@lo:400:kworker.0 Request processed in 20us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634138:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783969227.634152:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783969227.634157:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099194112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634184:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099194112:12345-0@lo:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634189:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783969227.634210:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783969227.634216:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099194624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634245:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099194624:12345-0@lo:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634251:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783969227.634261:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783969227.634266:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099195136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634290:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099195136:12345-0@lo:400:kworker.0 Request processed in 25us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634296:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783969227.634306:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783969227.634312:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099194368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634339:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099194368:12345-0@lo:400:kworker.0 Request processed in 28us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634345:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783969227.634371:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099194240 00000100:00100000:1.0:1783969227.634374:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099194240 00000100:00100000:1.0:1783969227.634429:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783969227.634436:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099194240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634467:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099194240:12345-0@lo:400:kworker.0 Request processed in 31us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634473:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783969227.634490:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099194752 00000100:00100000:1.0:1783969227.634493:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099194752 00000100:00100000:1.0:1783969227.634510:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099195264 00000100:00100000:1.0:1783969227.634513:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099195264 00000100:00100000:1.0:1783969227.634522:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099194880 00000100:00100000:1.0:1783969227.634530:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099194880 00000100:00100000:1.0:1783969227.634544:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099195392 00000100:00100000:1.0:1783969227.634546:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099195392 00000100:00100000:1.0:1783969227.634558:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783969227.634563:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099194752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634595:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099194752:12345-0@lo:400:kworker.0 Request processed in 31us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634601:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783969227.634610:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783969227.634615:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099195264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634640:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099195264:12345-0@lo:400:kworker.0 Request processed in 24us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634645:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783969227.634654:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969227.634659:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099194880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634681:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099194880:12345-0@lo:400:kworker.0 Request processed in 22us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634687:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969227.634697:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969227.634702:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099195392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634724:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099195392:12345-0@lo:400:kworker.0 Request processed in 23us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969227.634731:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969227.634785:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099194368:0@lo:400:kworker.0 00010000:00080000:1.0:1783969227.634799:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983491180 x1870627099194880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969227.634820:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099194880:0@lo:400:kworker.0 00010000:00080000:1.0:1783969227.634832:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a46300 x1870627099195392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969227.634840:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099195392:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634850:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099194240:0@lo:400:kworker.0 00010000:00080000:1.0:1783969227.634859:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981acad80 x1870627099194752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969227.634867:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099194752:0@lo:400:kworker.0 00010000:00080000:1.0:1783969227.634876:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a44a80 x1870627099195264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969227.634885:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099195264:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634943:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099194112:0@lo:400:kworker.0 00010000:00080000:1.0:1783969227.634953:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981ac8700 x1870627099194624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969227.634961:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099194624:0@lo:400:kworker.0 00010000:00080000:1.0:1783969227.634970:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a47480 x1870627099195136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969227.634977:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099195136:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634986:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099193984:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.634994:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099194496:0@lo:400:kworker.0 00000100:00100000:1.0:1783969227.635014:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099195008:0@lo:400:kworker.0 00000100:00100000:2.0:1783969227.635544:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969227.635557:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099195520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969227.635599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969227.635633:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099195520 00000100:00100000:2.0:1783969227.635637:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099195520 00000100:00100000:2.0:1783969227.635670:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783969227.635676:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099195520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783969227.635703:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969227.635739:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099195520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969227.635746:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1783969227.635775:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e982423480 x1870627099195520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969227.635796:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099195520:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783969227.636441:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969227.636447:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969227.636451:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969227.636454:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969227.637367:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099195648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969227.637435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969227.637473:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099195648 00000100:00100000:3.0:1783969227.637485:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099195648 00000100:00100000:3.0:1783969227.637521:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783969227.637528:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099195648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969227.637546:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969227.637581:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099195648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969227.637587:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1783969227.637617:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf7fa680 x1870627099195648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969227.637631:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099195648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969228.144605:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099195776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969228.144674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969228.144756:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099195776 00000100:00100000:2.0:1783969228.144763:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099195776 00000100:00100000:2.0:1783969228.144810:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783969228.144819:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099195776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969228.144847:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969228.144900:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099195776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969228.144907:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1783969228.144944:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262d180 x1870627099195776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969228.145261:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099195776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969228.145278:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969228.145551:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099195904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969228.145583:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969228.145652:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099195904 00000100:00100000:3.0:1783969228.145657:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099195904 00000100:00100000:3.0:1783969228.145693:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783969228.145700:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099195904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969228.145715:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969228.145755:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099195904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969228.145761:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1783969228.145821:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff3480 x1870627099195904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969228.145834:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099195904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783969228.597033:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969229.617334:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783969229.901333:0:11321:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:2.0:1783969230.640685:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783969231.662199:0:11369:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 13 15:00:29 EDT 2026 00010000:00010000:1.0:1783969231.665634:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969231.738207:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099196032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969231.738280:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969231.738358:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099196032 00000100:00100000:3.0:1783969231.738366:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099196032 00000100:00100000:3.0:1783969231.738438:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783969231.738447:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099196032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969231.738496:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783969231.738558:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099196032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969231.738566:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783969231.738614:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099196032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969232.240653:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969232.240678:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099196160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969232.240741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969232.242133:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099196160 00000100:00100000:2.0:1783969232.242145:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099196160 00000100:00100000:2.0:1783969232.242213:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783969232.242223:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099196160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969232.242259:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969232.242353:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099196160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969232.242360:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783969232.242558:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099196160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969232.651363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969232.651446:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969232.651483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969232.651586:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073959680 00000100:00100000:0.0:1783969232.651592:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073959936 00000100:00100000:2.0:1783969232.651598:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073959680 00000100:00100000:0.0:1783969232.651598:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073959936 00000100:00100000:2.0:1783969232.651649:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 285 00000100:00100000:0.0:1783969232.651651:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073959808 00000100:00100000:0.0:1783969232.651654:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073959808 00000100:00100000:2.0:1783969232.651658:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073959680:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969232.651670:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:0.0:1783969232.651677:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073959936:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969232.651727:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2391:x1870627073959680:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 69us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969232.651735:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 285 00000100:00100000:3.0:1783969232.651739:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:3.0:1783969232.651748:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073959808:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:1.0:1783969232.651802:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969232.651806:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969232.656150:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073959936:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 4460us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969232.656166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:3.0:1783969232.656449:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073959808:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 4699us (4961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969232.656458:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 109 00010000:00010000:3.0:1783969232.688872:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969232.752672:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099196288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969232.752747:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969232.752870:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099196288 00000100:00100000:2.0:1783969232.752879:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099196288 00000100:00100000:2.0:1783969232.752940:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783969232.752951:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099196288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783969232.752980:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969232.753031:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099196288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969232.753038:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1783969232.753081:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e982421f80 x1870627099196288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969232.753102:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099196288:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783969232.753167:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969232.753374:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969232.753397:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099196416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969232.753426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969232.753499:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099196416 00000100:00100000:1.0:1783969232.753504:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099196416 00000100:00100000:1.0:1783969232.753542:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783969232.753549:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099196416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969232.753561:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969232.753607:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099196416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969232.753614:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1783969232.753852:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783969232.753878:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8e967800 x1870627099196416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969232.753899:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099196416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969232.754135:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099196800:0@lo:400:kworker.0 00000100:00100000:2.0:1783969232.754167:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969232.754193:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099197312:0@lo:400:kworker.0 00000100:00100000:2.0:1783969232.754216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969232.754235:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783969232.754240:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099196928:0@lo:400:kworker.0 00000100:00100000:2.0:1783969232.754263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969232.754279:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099197440:0@lo:400:kworker.0 00000100:00100000:2.0:1783969232.754300:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969232.754325:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099197312 00000100:00100000:2.0:1783969232.754329:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099197312 00000100:00100000:2.0:1783969232.754356:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099197440 00000100:00100000:2.0:1783969232.754359:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099197440 00000100:00100000:2.0:1783969232.754375:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783969232.754402:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099197312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969232.754435:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099197312:12345-0@lo:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969232.754441:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783969232.754454:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783969232.754459:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099197440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969232.754479:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099197440:12345-0@lo:400:kworker.0 Request processed in 20us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969232.754484:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783969232.754507:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099196928 00000100:00100000:2.0:1783969232.754510:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099196928 00000100:00100000:2.0:1783969232.754532:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783969232.754538:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099196928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969232.754577:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099196928:12345-0@lo:400:kworker.0 Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969232.754583:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1783969232.754607:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969232.754622:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099196928:0@lo:400:kworker.0 00010000:00080000:2.0:1783969232.754631:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e6680 x1870627099197440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969232.754639:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099197440:0@lo:400:kworker.0 00010000:00080000:2.0:1783969232.754647:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983710380 x1870627099197312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969232.754654:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099197312:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.754785:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099196672:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.754814:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969232.754850:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099197184:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.754870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969232.754885:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099197696:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.754904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969232.754920:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783969232.754925:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099196544:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.754949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969232.754970:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099197056:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.754988:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969232.755001:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099197568:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755030:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969232.755054:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099196672 00000100:00100000:3.0:1783969232.755058:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099196672 00000100:00100000:3.0:1783969232.755078:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099197184 00000100:00100000:3.0:1783969232.755080:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099197184 00000100:00100000:3.0:1783969232.755101:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099197696 00000100:00100000:3.0:1783969232.755104:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099197696 00000100:00100000:3.0:1783969232.755115:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099197056 00000100:00100000:3.0:1783969232.755117:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099197056 00000100:00100000:3.0:1783969232.755128:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099197568 00000100:00100000:3.0:1783969232.755130:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099197568 00000100:00100000:3.0:1783969232.755143:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783969232.755149:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099196672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755184:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099196672:12345-0@lo:400:kworker.0 Request processed in 35us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969232.755191:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783969232.755203:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783969232.755208:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099197184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755234:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099197184:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969232.755239:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783969232.755249:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783969232.755256:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099197696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755278:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099197696:12345-0@lo:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969232.755284:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783969232.755292:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783969232.755297:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099197056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755329:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099197056:12345-0@lo:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969232.755335:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783969232.755346:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783969232.755352:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099197568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755376:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099197568:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969232.755402:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783969232.755420:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099196544 00000100:00100000:3.0:1783969232.755422:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099196544 00000100:00100000:3.0:1783969232.755446:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1783969232.755452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099196544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099196544:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969232.755486:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:3.0:1783969232.755518:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969232.755522:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969232.755544:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099196544:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755555:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099197056:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755564:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099197568:0@lo:400:kworker.0 00000100:00100000:3.0:1783969232.755591:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099196672:0@lo:400:kworker.0 00010000:00080000:3.0:1783969232.755602:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983710700 x1870627099197184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969232.755612:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099197184:0@lo:400:kworker.0 00010000:00080000:3.0:1783969232.755630:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e4380 x1870627099197696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969232.755640:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099197696:0@lo:400:kworker.0 00000100:00100000:0.0:1783969232.755872:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099196800 00000100:00100000:0.0:1783969232.755877:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099196800 00000100:00100000:0.0:1783969232.755913:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783969232.755920:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099196800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969232.755962:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099196800:12345-0@lo:400:kworker.0 Request processed in 42us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969232.755968:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783969232.756086:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099196800:0@lo:400:kworker.0 00000100:00100000:1.0:1783969233.264503:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969233.264537:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099197824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969233.264607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969233.264673:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099197824 00000100:00100000:1.0:1783969233.264680:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099197824 00000100:00100000:1.0:1783969233.264727:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783969233.264736:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099197824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969233.264765:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969233.264818:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099197824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969233.264826:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1783969233.264867:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8e967800 x1870627099197824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969233.264893:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099197824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969233.265495:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969233.265508:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099197952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969233.265545:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969233.265577:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099197952 00000100:00100000:2.0:1783969233.265581:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099197952 00000100:00100000:2.0:1783969233.265607:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783969233.265614:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099197952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969233.265630:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969233.265664:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099197952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969233.265677:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1783969233.265710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e4700 x1870627099197952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969233.265724:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099197952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783969233.715867:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969234.737684:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969235.761150:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969236.788824:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969236.860206:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969236.860230:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099198080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969236.860301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969236.860368:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099198080 00000100:00100000:1.0:1783969236.860376:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099198080 00000100:00100000:1.0:1783969236.860450:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783969236.860459:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099198080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969236.860498:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969236.860540:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099198080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969236.860561:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783969236.860604:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099198080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969237.361641:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099198208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969237.361720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969237.361874:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099198208 00000100:00100000:3.0:1783969237.361883:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099198208 00000100:00100000:3.0:1783969237.361937:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783969237.361947:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099198208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969237.361983:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783969237.368628:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099198208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6671us (6896us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969237.368644:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783969237.377497:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099198208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969237.774114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969237.774213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969237.774306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969237.774471:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073960320 00000100:00100000:0.0:1783969237.774485:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073960320 00000100:00100000:0.0:1783969237.774557:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073960192 00000100:00100000:0.0:1783969237.774560:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073960192 00000100:00100000:0.0:1783969237.774587:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:0.0:1783969237.774605:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073960320:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969237.774699:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073960320:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 97us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969237.774709:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:0.0:1783969237.774727:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:0.0:1783969237.774744:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073960192:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969237.774772:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073960192:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 38us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969237.774777:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00080000:0.0:1783969237.775482:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969237.775490:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969237.775585:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073960064 00000100:00100000:3.0:1783969237.775593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073960064 00000100:00100000:3.0:1783969237.775672:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 287 00000100:00100000:3.0:1783969237.775681:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627073960064:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969237.775745:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627073960064:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 57us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969237.775753:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 287 00010000:00010000:1.0:1783969237.812526:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969237.873370:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969237.873445:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099198336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969237.873546:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969237.874949:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099198336 00000100:00100000:1.0:1783969237.874963:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099198336 00000100:00100000:1.0:1783969237.875070:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783969237.875086:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099198336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969237.875132:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969237.875580:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099198848:0@lo:400:kworker.0 00000100:00080000:0.0:1783969237.875650:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969237.875665:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099198592:0@lo:400:kworker.0 00000100:00100000:3.0:1783969237.881514:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099198464:0@lo:400:kworker.0 00000100:00100000:2.0:1783969237.881659:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969237.881728:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099199360:0@lo:400:kworker.0 00000100:00100000:2.0:1783969237.881778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969237.881813:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099199872:0@lo:400:kworker.0 00000100:00100000:2.0:1783969237.882005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969237.882067:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099198848 00000100:00100000:2.0:1783969237.882077:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099198848 00000100:00100000:2.0:1783969237.882144:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783969237.882154:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099198848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969237.882476:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099198848:12345-0@lo:400:kworker.0 Request processed in 322us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969237.882485:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783969237.882517:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099199360 00000100:00100000:2.0:1783969237.882521:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099199360 00000100:00100000:2.0:1783969237.882557:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099199872 00000100:00100000:2.0:1783969237.882560:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099199872 00000100:00100000:2.0:1783969237.882580:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783969237.882587:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099199360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969237.882624:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099199360:12345-0@lo:400:kworker.0 Request processed in 37us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969237.882648:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783969237.882661:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783969237.882667:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099199872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969237.882699:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099199872:12345-0@lo:400:kworker.0 Request processed in 32us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969237.882704:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783969237.882774:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099198848:0@lo:400:kworker.0 00010000:00080000:2.0:1783969237.882789:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983710700 x1870627099199360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969237.882799:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099199360:0@lo:400:kworker.0 00000100:00080000:0.0:1783969237.883102:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969237.883108:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969237.883144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969237.883175:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099198592 00000100:00100000:0.0:1783969237.883179:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099198592 00000100:00100000:0.0:1783969237.883232:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783969237.883240:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099198592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.883276:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099198592:12345-0@lo:400:kworker.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969237.883283:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783969237.883334:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099198592:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.883346:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099199104:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.883374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969237.883417:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099199104 00000100:00100000:0.0:1783969237.883421:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099199104 00010000:00080000:2.0:1783969237.883762:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319df80 x1870627099199872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969237.883775:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099199872:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.886809:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783969237.886833:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099199104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.886963:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099199104:12345-0@lo:400:kworker.0 Request processed in 133us (3586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969237.886972:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783969237.887085:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099199104:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.887101:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099199616:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.887145:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969237.887175:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099199616 00000100:00100000:0.0:1783969237.887182:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099199616 00000100:00100000:0.0:1783969237.887221:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783969237.887227:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099199616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.887570:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099199616:12345-0@lo:400:kworker.0 Request processed in 341us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969237.887577:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783969237.887610:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099199616:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.887645:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783969237.887652:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099198720:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.887682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969237.887709:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099198720 00000100:00100000:0.0:1783969237.887744:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099198720 00000100:00100000:0.0:1783969237.887777:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783969237.887784:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099198720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.888560:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099198720:12345-0@lo:400:kworker.0 Request processed in 770us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969237.888571:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783969237.888627:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099198720:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.888638:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099199232:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.888680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969237.888710:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099199232 00000100:00100000:0.0:1783969237.888715:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099199232 00000100:00100000:0.0:1783969237.888763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783969237.888771:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099199232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.888811:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099199232:12345-0@lo:400:kworker.0 Request processed in 42us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969237.889675:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:0.0:1783969237.889776:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983713480 x1870627099199232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969237.890083:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099199232:0@lo:400:kworker.0 00000100:00080000:2.0:1783969237.890215:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969237.890222:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969237.890945:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099199744:0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.891563:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969237.891750:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099199744 00000100:00100000:2.0:1783969237.891760:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099199744 00000100:00100000:2.0:1783969237.891860:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783969237.891872:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099199744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969237.891950:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099199744:12345-0@lo:400:kworker.0 Request processed in 80us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969237.891958:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1783969237.892978:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783969237.895505:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983710000 x1870627099199744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969237.895531:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099199744:0@lo:400:kworker.0 00000100:00100000:3.0:1783969237.897217:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969237.897297:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099198976:0@lo:400:kworker.0 00000100:00100000:3.0:1783969237.897344:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969237.897376:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099199488:0@lo:400:kworker.0 00000100:00100000:3.0:1783969237.897451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969237.897481:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099200000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969237.897509:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969237.897553:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099200000 00000100:00100000:3.0:1783969237.897562:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099200000 00000100:00100000:3.0:1783969237.897624:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783969237.897636:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099200000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783969237.897670:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969237.897724:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099200000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969237.897744:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783969237.897776:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099199488 00000100:00100000:3.0:1783969237.897780:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099199488 00000100:00100000:1.0:1783969237.897987:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099198336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 22904us (24439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969237.897997:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1783969237.898056:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969237.898286:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099198464 00000100:00100000:2.0:1783969237.898293:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099198464 00000100:00100000:2.0:1783969237.898348:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783969237.898356:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099198464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969237.898426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099198464:12345-0@lo:400:kworker.0 Request processed in 71us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969237.898432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1783969237.899222:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099198976 00000100:00100000:0.0:1783969237.899232:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099198976 00000100:00100000:0.0:1783969237.899294:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783969237.899302:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099198976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969237.899373:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099198976:12345-0@lo:400:kworker.0 Request processed in 72us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969237.899406:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783969237.901535:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783969237.901555:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099199488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969237.901662:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099199488:12345-0@lo:400:kworker.0 Request processed in 114us (4209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969237.901670:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1783969237.901748:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983491180 x1870627099198336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969237.901776:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099198336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969237.901840:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099198464:0@lo:400:kworker.0 00000100:00100000:3.0:1783969237.901854:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099198976:0@lo:400:kworker.0 00010000:00080000:3.0:1783969237.901866:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983713b80 x1870627099199488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969237.901901:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099199488:0@lo:400:kworker.0 00010000:00080000:3.0:1783969237.901918:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf7fbb80 x1870627099200000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969237.901931:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099200000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969238.387659:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099200128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969238.387780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969238.387889:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099200128 00000100:00100000:1.0:1783969238.387900:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099200128 00000100:00100000:1.0:1783969238.387978:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783969238.387990:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099200128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969238.388045:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969238.388109:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099200128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969238.388117:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1783969238.388172:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319df80 x1870627099200128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969238.388194:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099200128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969238.388678:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969238.388690:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099200256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969238.388739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969238.388781:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099200256 00000100:00100000:1.0:1783969238.388787:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099200256 00000100:00100000:1.0:1783969238.388827:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783969238.388835:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099200256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969238.388852:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969238.388886:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099200256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969238.388893:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1783969238.388922:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319ed80 x1870627099200256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969238.388937:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099200256:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783969238.833097:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969239.856940:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969240.880894:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969241.904731:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969241.973305:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099200384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969241.973413:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969241.973676:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099200384 00000100:00100000:0.0:1783969241.973686:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099200384 00000100:00100000:0.0:1783969241.973761:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783969241.973772:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099200384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969241.973815:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783969241.973870:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099200384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969241.973878:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783969241.974641:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099200384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969242.483299:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099200512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969242.483430:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969242.485130:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099200512 00000100:00100000:2.0:1783969242.485151:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099200512 00000100:00100000:2.0:1783969242.485243:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783969242.485256:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099200512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969242.485306:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969242.485439:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099200512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 185us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969242.485447:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783969242.488526:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099200512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969242.894849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969242.894899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969242.894931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969242.894964:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073960448 00000100:00100000:0.0:1783969242.894976:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073960448 00000100:00100000:0.0:1783969242.895038:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 289 00000100:00100000:0.0:1783969242.895051:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627073960448:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969242.895602:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627073960448:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 550us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.895613:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 289 00000100:00100000:0.0:1783969242.895675:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073960576 00000100:00100000:0.0:1783969242.895680:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073960576 00000100:00100000:0.0:1783969242.895724:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073960704 00000100:00100000:0.0:1783969242.895728:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073960704 00000100:00100000:0.0:1783969242.895751:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:0.0:1783969242.895758:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073960576:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969242.895856:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073960576:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 98us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.895864:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:0.0:1783969242.895877:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:0.0:1783969242.895883:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073960704:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969242.895910:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073960704:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.895917:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00080000:0.0:1783969242.896058:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969242.896063:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783969242.929757:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969242.997363:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099200768:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.997554:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099201280:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.997604:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099201792:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997637:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.997679:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1783969242.997687:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099200640:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.997752:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099201152:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.997798:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099201664:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.997841:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099202176:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.997888:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099200896:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.997931:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099201408:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997952:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.997968:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099201920:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.997989:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.998005:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783969242.998011:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099201024:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.998044:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099201536:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998065:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.998084:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099202048:0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969242.998140:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099200768 00000100:00100000:0.0:1783969242.998157:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099200768 00000100:00100000:0.0:1783969242.998208:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099201280 00000100:00100000:0.0:1783969242.998211:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099201280 00000100:00100000:0.0:1783969242.998240:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099201792 00000100:00100000:0.0:1783969242.998243:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099201792 00000100:00100000:0.0:1783969242.998254:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099201408 00000100:00100000:0.0:1783969242.998257:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099201408 00000100:00100000:0.0:1783969242.998268:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099201920 00000100:00100000:0.0:1783969242.998270:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099201920 00000100:00100000:0.0:1783969242.998280:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099201024 00000100:00100000:0.0:1783969242.998282:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099201024 00000100:00100000:0.0:1783969242.998297:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783969242.998305:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099200768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998369:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099200768:12345-0@lo:400:kworker.0 Request processed in 63us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.998377:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783969242.998423:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783969242.998430:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099201280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998459:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099201280:12345-0@lo:400:kworker.0 Request processed in 30us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.998465:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783969242.998477:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783969242.998483:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099201792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998509:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099201792:12345-0@lo:400:kworker.0 Request processed in 26us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.998514:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783969242.998525:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783969242.998530:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099201408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998572:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099201408:12345-0@lo:400:kworker.0 Request processed in 41us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.998578:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783969242.998589:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783969242.998594:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099201920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998620:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099201920:12345-0@lo:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.998625:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783969242.998635:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783969242.998640:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099201024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998679:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099201024:12345-0@lo:400:kworker.0 Request processed in 39us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.998684:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783969242.998712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099200640 00000100:00100000:0.0:1783969242.998716:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099200640 00000100:00100000:0.0:1783969242.998741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1783969242.998746:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099200640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969242.998780:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099200640:12345-0@lo:400:kworker.0 Request processed in 33us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969242.998786:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1783969242.998818:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099201152 00000100:00100000:0.0:1783969242.998822:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099201152 00000100:00100000:2.0:1783969242.999686:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099200896 00000100:00100000:2.0:1783969242.999695:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099200896 00000100:00100000:2.0:1783969242.999793:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783969242.999805:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099200896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969242.999872:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099200896:12345-0@lo:400:kworker.0 Request processed in 70us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969242.999879:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783969242.999910:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099201664 00000100:00100000:2.0:1783969242.999913:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099201664 00000100:00100000:2.0:1783969242.999938:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099202176 00000100:00100000:2.0:1783969242.999940:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099202176 00000100:00100000:2.0:1783969242.999952:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099201536 00000100:00100000:2.0:1783969242.999954:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099201536 00000100:00100000:2.0:1783969242.999966:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099202048 00000100:00100000:2.0:1783969242.999969:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099202048 00000100:00100000:2.0:1783969243.000000:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783969243.000006:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099201664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969243.000042:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099201664:12345-0@lo:400:kworker.0 Request processed in 36us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969243.000048:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783969243.000059:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783969243.000391:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783969243.000399:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099201152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969243.000434:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099201152:12345-0@lo:400:kworker.0 Request processed in 36us (2652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969243.000446:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783969243.000547:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099202176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969243.000603:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099202176:12345-0@lo:400:kworker.0 Request processed in 537us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969243.000610:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783969243.000624:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969243.000631:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099201536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969243.000673:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099201536:12345-0@lo:400:kworker.0 Request processed in 43us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969243.000679:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969243.000689:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783969243.000695:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099202048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969243.000720:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099202048:12345-0@lo:400:kworker.0 Request processed in 26us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969243.000726:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1783969243.000825:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969243.000830:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783969243.000834:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969243.000837:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969243.000888:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099200640:0@lo:400:kworker.0 00000100:00100000:0.0:1783969243.000907:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099201152:0@lo:400:kworker.0 00010000:00080000:0.0:1783969243.000926:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5500 x1870627099201664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969243.000937:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099201664:0@lo:400:kworker.0 00010000:00080000:0.0:1783969243.000950:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9834f5180 x1870627099202176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969243.000958:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099202176:0@lo:400:kworker.0 00000100:00100000:0.0:1783969243.000975:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099200768:0@lo:400:kworker.0 00000100:00100000:0.0:1783969243.000988:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099201280:0@lo:400:kworker.0 00000100:00100000:0.0:1783969243.001001:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099201792:0@lo:400:kworker.0 00000100:00100000:0.0:1783969243.001063:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099201024:0@lo:400:kworker.0 00010000:00080000:0.0:1783969243.001692:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6a00 x1870627099201536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969243.001705:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099201536:0@lo:400:kworker.0 00010000:00080000:0.0:1783969243.001719:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9834f7100 x1870627099202048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969243.002142:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099202048:0@lo:400:kworker.0 00000100:00100000:0.0:1783969243.002163:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099200896:0@lo:400:kworker.0 00010000:00080000:0.0:1783969243.002177:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff4a80 x1870627099201408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969243.002186:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099201408:0@lo:400:kworker.0 00010000:00080000:0.0:1783969243.002200:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9834f4e00 x1870627099201920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969243.002207:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099201920:0@lo:400:kworker.0 00000100:00100000:0.0:1783969243.002242:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099202432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969243.002307:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969243.002582:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969243.002596:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099202304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969243.007942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969243.013208:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099202432 00000100:00100000:1.0:1783969243.013226:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099202432 00000100:00100000:1.0:1783969243.013312:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099202304 00000100:00100000:1.0:1783969243.013317:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099202304 00000100:00100000:1.0:1783969243.013343:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783969243.014635:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099202432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969243.014698:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969243.014824:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099202432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (12515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969243.014834:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783969243.014864:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783969243.014871:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099202304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969243.014880:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969243.014913:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099202304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (6984us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969243.014918:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1783969243.014979:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf744e00 x1870627099202432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969243.015002:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099202432:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783969243.015454:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf746d80 x1870627099202304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969243.015480:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099202304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969243.505604:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969243.505638:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099202560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969243.505786:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969243.506076:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099202560 00000100:00100000:1.0:1783969243.506102:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099202560 00000100:00100000:1.0:1783969243.506160:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783969243.506171:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099202560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969243.506202:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969243.506252:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099202560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969243.506268:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1783969243.506453:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf744e00 x1870627099202560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969243.506474:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099202560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969243.510521:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099202688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783969243.510628:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969243.510848:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099202688 00000100:00100000:2.0:1783969243.510858:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099202688 00000100:00100000:2.0:1783969243.510930:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969243.510944:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099202688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969243.510997:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969243.511067:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099202688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969243.511076:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1783969243.512001:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319f100 x1870627099202688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969243.512031:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099202688:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783969243.952553:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969244.978103:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969246.003318:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969247.026107:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969247.089292:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099202816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969247.089430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969247.089955:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099202816 00000100:00100000:1.0:1783969247.089966:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099202816 00000100:00100000:1.0:1783969247.090225:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783969247.090241:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e9a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099202816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969247.090300:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969247.090417:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e9a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099202816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969247.090425:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783969247.090884:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099202816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969247.603566:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969247.603630:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099202944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969247.603729:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969247.603948:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099202944 00000100:00100000:2.0:1783969247.603959:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099202944 00000100:00100000:2.0:1783969247.604028:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783969247.604041:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099202944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969247.604089:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969247.604157:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099202944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969247.604166:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783969247.604315:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099202944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969248.013513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969248.013565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969248.013619:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969248.013710:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073961088 00000100:00100000:1.0:1783969248.013724:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073961088 00000100:00100000:1.0:1783969248.013813:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073960960 00000100:00100000:1.0:1783969248.013817:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073960960 00000100:00100000:1.0:1783969248.013845:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:1.0:1783969248.013858:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073961088:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969248.013963:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073961088:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 107us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.013971:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:1.0:1783969248.013990:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:1.0:1783969248.013997:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073960960:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969248.014022:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073960960:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.014029:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00080000:0.0:1783969248.014215:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969248.014235:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969248.014909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073960832 00000100:00100000:2.0:1783969248.014918:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073960832 00000100:00100000:2.0:1783969248.014976:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 291 00000100:00100000:2.0:1783969248.014986:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627073960832:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969248.015049:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627073960832:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 65us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969248.015057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 291 00010000:00010000:0.0:1783969248.050990:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969248.112771:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099203072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969248.112883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969248.113021:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099203072 00000100:00100000:2.0:1783969248.113034:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099203072 00000100:00100000:2.0:1783969248.113120:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783969248.113134:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099203072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969248.113176:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969248.113422:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099203328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969248.113489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969248.113506:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099203200:0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.113531:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98370b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099203840:0@lo:400:kworker.0 00000100:00100000:3.0:1783969248.113557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969248.113584:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969248.113620:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099204352:0@lo:400:kworker.0 00000100:00100000:3.0:1783969248.113631:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099203712:0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.113654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969248.113685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969248.113693:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099203456:0@lo:400:kworker.0 00000100:00100000:3.0:1783969248.113710:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98370b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099204224:0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.113728:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969248.113741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969248.113755:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099203968:0@lo:400:kworker.0 00000100:00100000:3.0:1783969248.113768:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099204736:0@lo:400:kworker.0 00000100:00100000:3.0:1783969248.113788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969248.113820:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099204352 00000100:00100000:3.0:1783969248.113837:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099204352 00000100:00100000:3.0:1783969248.113887:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099204224 00000100:00100000:3.0:1783969248.113890:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099204224 00000100:00100000:3.0:1783969248.113913:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099204736 00000100:00100000:3.0:1783969248.113915:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099204736 00000100:00100000:3.0:1783969248.113929:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783969248.113940:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099204352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.113962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969248.113985:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099204480:0@lo:400:kworker.0 00000100:00100000:3.0:1783969248.114009:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099204352:12345-0@lo:400:kworker.0 Request processed in 68us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969248.114018:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783969248.114039:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783969248.114045:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099204224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.114086:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969248.114097:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099204224:12345-0@lo:400:kworker.0 Request processed in 52us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969248.114105:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783969248.114115:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783969248.114124:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099203584:0@lo:400:kworker.0 00000100:00100000:3.0:1783969248.114131:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783969248.114139:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099204736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.114153:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969248.114177:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099204096:0@lo:400:kworker.0 00000100:00100000:3.0:1783969248.114181:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099204736:12345-0@lo:400:kworker.0 Request processed in 41us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969248.114189:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783969248.114206:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969248.114225:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099204608:0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.114249:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969248.114271:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099203328 00000100:00100000:1.0:1783969248.114276:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099203328 00000100:00100000:1.0:1783969248.114305:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783969248.114313:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099203328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969248.114328:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969248.114360:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099203328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.114374:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783969248.114428:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099203712 00000100:00100000:1.0:1783969248.114432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099203712 00000100:00100000:1.0:1783969248.114452:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099203456 00000100:00100000:1.0:1783969248.114454:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099203456 00000100:00100000:1.0:1783969248.114466:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099203968 00000100:00100000:1.0:1783969248.114468:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099203968 00000100:00100000:1.0:1783969248.114484:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099204480 00000100:00100000:1.0:1783969248.114486:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099204480 00000100:00100000:1.0:1783969248.114499:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099204096 00000100:00100000:1.0:1783969248.114502:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099204096 00000100:00100000:1.0:1783969248.114515:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099204608 00000100:00100000:1.0:1783969248.114518:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099204608 00000100:00100000:1.0:1783969248.114531:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783969248.114537:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099203712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.114586:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099203712:12345-0@lo:400:kworker.0 Request processed in 48us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.114698:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783969248.114716:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783969248.114723:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099203456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.114758:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099203456:12345-0@lo:400:kworker.0 Request processed in 36us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.114776:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783969248.114787:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783969248.114793:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099203968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.114828:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099203968:12345-0@lo:400:kworker.0 Request processed in 35us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.114834:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783969248.114854:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783969248.114860:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099204480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.114887:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099204480:12345-0@lo:400:kworker.0 Request processed in 28us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.114893:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783969248.114904:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783969248.114910:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099204096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.114936:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099204096:12345-0@lo:400:kworker.0 Request processed in 27us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.114943:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783969248.114952:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783969248.114957:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099204608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.114983:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099204608:12345-0@lo:400:kworker.0 Request processed in 25us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.114989:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783969248.115030:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099203840 00000100:00100000:1.0:1783969248.115035:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099203840 00000100:00100000:1.0:1783969248.115054:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099203584 00000100:00100000:1.0:1783969248.115056:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099203584 00000100:00100000:1.0:1783969248.115068:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783969248.115075:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099203840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.115110:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099203840:12345-0@lo:400:kworker.0 Request processed in 36us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.115116:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783969248.115127:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783969248.115133:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099203584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.115173:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099203584:12345-0@lo:400:kworker.0 Request processed in 40us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.115179:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783969248.115230:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099203584:0@lo:400:kworker.0 00010000:00080000:1.0:1783969248.115245:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983708000 x1870627099204096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969248.115256:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099204096:0@lo:400:kworker.0 00010000:00080000:1.0:1783969248.115267:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983709880 x1870627099204608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969248.115275:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099204608:0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.115286:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099203456:0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.115296:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099203968:0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.115304:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099204480:0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.115352:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98370b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099203840:0@lo:400:kworker.0 00010000:00080000:1.0:1783969248.115363:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98370bb80 x1870627099204352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969248.115373:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099204352:0@lo:400:kworker.0 00010000:00080000:1.0:1783969248.115410:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf745c00 x1870627099203328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969248.115425:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099203328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969248.115479:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099203200 00000100:00100000:1.0:1783969248.115490:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099203200 00000100:00100000:1.0:1783969248.115523:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1783969248.115530:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099203200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.115582:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099203200:12345-0@lo:400:kworker.0 Request processed in 39us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.115589:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:1.0:1783969248.115678:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969248.115683:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969248.115686:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969248.115689:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969248.115847:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099203200:0@lo:400:kworker.0 00000100:00100000:1.0:1783969248.115859:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099203712:0@lo:400:kworker.0 00010000:00080000:1.0:1783969248.115871:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98370b480 x1870627099204224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969248.115879:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98370b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099204224:0@lo:400:kworker.0 00010000:00080000:1.0:1783969248.115889:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98370ad80 x1870627099204736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969248.115896:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099204736:0@lo:400:kworker.0 00000100:00100000:2.0:1783969248.127980:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099203072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14831us (15077us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969248.128026:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1783969248.128240:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf747480 x1870627099203072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969248.128290:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099203072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969248.624717:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969248.624749:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099204864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969248.624839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969248.624919:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099204864 00000100:00100000:1.0:1783969248.624927:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099204864 00000100:00100000:1.0:1783969248.624985:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783969248.624995:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099204864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969248.625052:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969248.625099:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099204864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969248.625108:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1783969248.625161:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf745c00 x1870627099204864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969248.625185:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099204864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969248.625418:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969248.625430:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099204992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969248.625465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969248.625498:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099204992 00000100:00100000:2.0:1783969248.625502:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099204992 00000100:00100000:2.0:1783969248.625528:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783969248.625535:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099204992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969248.625547:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969248.625586:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099204992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969248.625593:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1783969248.625619:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319f100 x1870627099204992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969248.625632:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099204992:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783969249.086348:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783969249.201051:0:11999:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:00:46 (1783969246) === 00000100:00100000:0.0:1783969249.703453:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969249.703835:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073961216 00000100:00100000:2.0:1783969249.703847:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073961216 00000100:00100000:2.0:1783969249.703909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 293 00000100:00100000:2.0:1783969249.703920:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:8719:x1870627073961216:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783969249.703937:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969249.703954:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad9000/0xea31253a47cb9bb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969249.703983:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad9000/0xea31253a47cb9bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303728 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969249.704007:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad9000/0xea31253a47cb9bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303728 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969249.704018:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9000, rc 0) 00000100:00100000:2.0:1783969249.704076:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8719:x1870627073961216:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 158us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969249.704492:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 293 00000100:00100000:1.0:1783969249.714702:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969249.714961:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073961344 00000100:00100000:0.0:1783969249.714970:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073961344 00000100:00100000:0.0:1783969249.715033:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 294 00000100:00100000:0.0:1783969249.715045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8719:x1870627073961344:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783969249.715228:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8719:x1870627073961344:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 185us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969249.715237:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 294 00000100:00100000:0.0:1783969249.720297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969249.724149:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073961472 00000100:00100000:1.0:1783969249.724165:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073961472 00000100:00100000:1.0:1783969249.724243:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 295 00000100:00100000:1.0:1783969249.724254:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8719:x1870627073961472:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783969249.724443:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8719:x1870627073961472:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 189us (4154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.724451:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 295 00000100:00100000:1.0:1783969249.737342:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969249.741865:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073961600 00000100:00100000:2.0:1783969249.741881:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073961600 00000100:00100000:2.0:1783969249.741958:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 296 00000100:00100000:2.0:1783969249.741969:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8723:x1870627073961600:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969249.742149:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8723:x1870627073961600:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 181us (4820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969249.742157:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 296 00000100:00100000:2.0:1783969249.779882:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969249.780278:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073961728 00000100:00100000:0.0:1783969249.780294:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073961728 00000100:00100000:0.0:1783969249.780376:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 297 00000100:00100000:0.0:1783969249.780429:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8723:x1870627073961728:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969249.780635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8723:x1870627073961728:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 208us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969249.780644:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 297 00000100:00100000:0.0:1783969249.787469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969249.787751:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073961856 00000100:00100000:1.0:1783969249.787765:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073961856 00000100:00100000:1.0:1783969249.787843:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 298 00000100:00100000:1.0:1783969249.787857:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8723:x1870627073961856:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783969249.788080:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8723:x1870627073961856:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 225us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.788090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 298 00000100:00100000:1.0:1783969249.796018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969249.796147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073961984 00000100:00100000:2.0:1783969249.796159:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073961984 00000100:00100000:2.0:1783969249.796238:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 299 00000100:00100000:2.0:1783969249.796250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:8719:x1870627073961984:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783969249.796273:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969249.796298:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb9bbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303759 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969249.796339:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb9bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303759 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969249.796377:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb9bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303759 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969249.796436:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad8a00, rc 0) 00000100:00100000:2.0:1783969249.796520:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:8719:x1870627073961984:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 271us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969249.796529:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 299 00000100:00100000:2.0:1783969249.802531:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969249.802810:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073962112 00000100:00100000:0.0:1783969249.802841:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073962112 00000100:00100000:0.0:1783969249.802913:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 300 00000100:00100000:0.0:1783969249.802924:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:8719:x1870627073962112:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783969249.802959:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783969249.802982:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783969249.802986:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783969249.802990:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783969249.802993:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783969249.802995:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1783969249.811623:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:8719:x1870627073962112:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 8664us (9072us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.811676:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 300 00000100:00100000:1.0:1783969249.819951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969249.821870:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073962240 00000100:00100000:0.0:1783969249.821891:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073962240 00000100:00100000:0.0:1783969249.822056:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 301 00000100:00100000:0.0:1783969249.822069:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:8719:x1870627073962240:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783969249.822093:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969249.822119:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303760 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969249.822160:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303760 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969249.822174:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303760 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969249.822185:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde600, rc 0) 00000100:00100000:0.0:1783969249.822282:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:8719:x1870627073962240:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 215us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969249.822290:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 301 00000100:00100000:2.0:1783969249.829731:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969249.830023:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073962368 00000100:00100000:1.0:1783969249.830036:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073962368 00000100:00100000:1.0:1783969249.830285:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 302 00000100:00100000:1.0:1783969249.830299:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:8719:x1870627073962368:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783969249.830581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:8719:x1870627073962368:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 284us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.830602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 302 00000100:00100000:1.0:1783969249.834151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969249.834260:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073962496 00000100:00100000:0.0:1783969249.834289:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073962496 00000100:00100000:0.0:1783969249.834363:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 303 00000100:00100000:0.0:1783969249.834376:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:8719:x1870627073962496:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783969249.834608:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:8719:x1870627073962496:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 234us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969249.834618:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 303 00000100:00100000:0.0:1783969249.843655:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969249.843811:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073962624 00000100:00100000:1.0:1783969249.843825:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073962624 00000100:00100000:1.0:1783969249.843901:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 304 00000100:00100000:1.0:1783969249.843914:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:8728:x1870627073962624:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783969249.844207:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:8728:x1870627073962624:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 294us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.844216:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 304 00000100:00100000:1.0:1783969249.852502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969249.855370:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073962752 00000100:00100000:2.0:1783969249.855471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073962752 00000100:00100000:2.0:1783969249.855865:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 305 00000100:00100000:2.0:1783969249.855882:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:8728:x1870627073962752:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969249.856133:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:8728:x1870627073962752:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 254us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969249.856143:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 305 00000100:00100000:2.0:1783969249.885465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969249.885510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969249.885618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969249.887460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969249.888036:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073963648 00000100:00100000:3.0:1783969249.888052:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073963648 00000100:00100000:1.0:1783969249.889343:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073963520 00000100:00100000:1.0:1783969249.889359:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073963520 00000100:00100000:1.0:1783969249.889440:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073962880 00000100:00100000:1.0:1783969249.889444:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073962880 00000100:00100000:1.0:1783969249.889457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073963136 00000100:00100000:1.0:1783969249.889459:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073963136 00000100:00100000:1.0:1783969249.889478:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:1.0:1783969249.889491:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073963648:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969249.889659:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073963648:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 171us (4211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.889680:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:1.0:1783969249.889702:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:1.0:1783969249.889714:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073963520:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969249.889744:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073963520:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 36us (4233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.889751:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:1.0:1783969249.889764:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1783969249.889770:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1870627073962880:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783969249.889801:0:6523:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898@192.168.201.34@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:1.0:1783969249.889849:0:6523:0:(genops.c:1406:class_connect()) connect: client 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898, cookie 0xea31253a47cb9bc9 00000004:00100000:1.0:1783969249.889886:0:6523:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783969249.890037:0:6523:0:(import.c:65:import_set_state_nolock()) ffff93e982785000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969249.890074:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2390:x1870627073962880:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 302us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.890095:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1783969249.890110:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1783969249.890115:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1870627073963136:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783969249.890130:0:6523:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898@192.168.201.34@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:1.0:1783969249.890156:0:6523:0:(genops.c:1406:class_connect()) connect: client 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898, cookie 0xea31253a47cb9bd0 00000004:00100000:1.0:1783969249.890169:0:6523:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783969249.890232:0:6523:0:(import.c:65:import_set_state_nolock()) ffff93e982787800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969249.893508:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2390:x1870627073963136:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 3373us (6041us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.893529:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1783969249.903098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969249.903218:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073963008 00000100:00100000:1.0:1783969249.903232:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073963008 00000100:00100000:1.0:1783969249.903336:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1783969249.903348:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:0:x1870627073963008:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783969249.903508:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969249.903658:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:0:x1870627073963008:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 312us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.903865:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00080000:0.0:1783969249.904198:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969249.913009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969249.913164:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073963392 00000100:00100000:0.0:1783969249.913179:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073963392 00000100:00100000:0.0:1783969249.913271:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1783969249.913284:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:8719:x1870627073963392:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783969249.913329:0:7749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783969249.913445:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:8719:x1870627073963392:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 163us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969249.913453:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1783969249.921924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969249.922920:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073963264 00000100:00100000:1.0:1783969249.922938:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073963264 00000100:00100000:1.0:1783969249.923041:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1783969249.923054:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:0:x1870627073963264:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783969249.923118:0:9027:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969249.923237:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:0:x1870627073963264:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 186us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969249.923247:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00080000:0.0:1783969249.923809:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969249.930832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969249.931310:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073963776 00000100:00100000:2.0:1783969249.931324:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073963776 00000100:00100000:0.0:1783969249.931516:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1783969249.931533:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:8719:x1870627073963776:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783969249.931694:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:8719:x1870627073963776:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 166us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969249.931703:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1783969249.942512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969249.942574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969249.942620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969249.942794:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073963904 00000100:00100000:1.0:1783969249.942807:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073963904 00000100:00100000:0.0:1783969249.942936:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073964160 00000100:00100000:0.0:1783969249.942941:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073964160 00000100:00100000:0.0:1783969249.942995:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1783969249.943023:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:8719:x1870627073964160:12345-192.168.201.34@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783969249.943140:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:8719:x1870627073964160:12345-192.168.201.34@tcp:900:mount.lustre.0 Request processed in 118us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969249.943150:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1783969249.944756:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073964032 00000100:00100000:0.0:1783969249.944772:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073964032 00000100:00100000:3.0:1783969249.948997:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:3.0:1783969249.949017:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1870627073963904:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783969249.949319:0:9974:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898@192.168.201.34@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:3.0:1783969249.949466:0:9974:0:(genops.c:1406:class_connect()) connect: client 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898, cookie 0xea31253a47cb9bd7 00002000:00100000:3.0:1783969249.949486:0:9974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898/ffff93eabf7e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783969249.949509:0:9974:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783969249.949883:0:9974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783969249.949931:0:9974:0:(import.c:65:import_set_state_nolock()) ffff93eabf7e1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969249.950109:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2390:x1870627073963904:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 1092us (7611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969249.950120:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:3.0:1783969249.950152:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1783969249.950158:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1870627073964032:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783969249.950185:0:9974:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898@192.168.201.34@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:3.0:1783969249.950217:0:9974:0:(genops.c:1406:class_connect()) connect: client 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898, cookie 0xea31253a47cb9bde 00002000:00100000:3.0:1783969249.950225:0:9974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898/ffff93eabf7e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783969249.950239:0:9974:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783969249.950288:0:9974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783969249.950304:0:9974:0:(import.c:65:import_set_state_nolock()) ffff93eabf7e6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969249.950330:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2390:x1870627073964032:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 170us (7718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969249.950357:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1783969249.953916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969249.962316:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073964288 00000100:00100000:3.0:1783969249.962336:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073964288 00000100:00100000:2.0:1783969249.962941:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:2.0:1783969249.962957:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:8719:x1870627073964288:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783969249.963251:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783969249.963463:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:8719:x1870627073964288:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 508us (9559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969249.963473:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00010000:00010000:1.0:1783969250.096919:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969251.120763:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969252.145883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969252.209916:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969252.209949:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099205120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969252.210038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969252.210174:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099205120 00000100:00100000:1.0:1783969252.210184:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099205120 00000100:00100000:1.0:1783969252.210267:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783969252.210277:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099205120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969252.210320:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969252.210429:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099205120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969252.210438:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783969252.210479:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099205120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969252.721620:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969252.722054:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099205248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969252.722146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969252.722220:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099205248 00000100:00100000:2.0:1783969252.722227:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099205248 00000100:00100000:2.0:1783969252.722273:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783969252.722282:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099205248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969252.722319:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969252.722365:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099205248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969252.722373:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783969252.722439:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099205248:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783969253.169786:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969253.232587:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099205376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969253.232747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.232823:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099205376 00000100:00100000:0.0:1783969253.232831:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099205376 00000100:00100000:0.0:1783969253.232883:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783969253.232893:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099205376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969253.232920:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969253.232963:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099205376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969253.232970:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1783969253.232989:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783969253.233026:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9834f5f80 x1870627099205376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969253.233043:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099205376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969253.234107:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099205504:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.234170:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.234199:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099206016:0@lo:400:kworker.0 00000100:00100000:2.0:1783969253.234219:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099205760:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.234238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969253.234261:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.234265:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099206528:0@lo:400:kworker.0 00000100:00100000:2.0:1783969253.234277:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099206272:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.234288:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969253.234298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.234308:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783969253.234312:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099206784:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.234312:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099205632:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.234338:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099205888:0@lo:400:kworker.0 00000100:00100000:2.0:1783969253.234344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.234365:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099205504 00000100:00100000:0.0:1783969253.234370:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099205504 00000100:00100000:2.0:1783969253.234403:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099206272 00000100:00100000:2.0:1783969253.234412:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099206272 00000100:00100000:0.0:1783969253.234420:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1783969253.234427:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099205504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969253.234440:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099206784 00000100:00100000:2.0:1783969253.234443:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099206784 00000100:00100000:2.0:1783969253.234461:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783969253.234464:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099205504:12345-0@lo:400:kworker.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969253.234467:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099206272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.234471:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1783969253.234512:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099206272:12345-0@lo:400:kworker.0 Request processed in 45us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969253.234520:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783969253.234544:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783969253.234550:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099206784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969253.234594:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099206784:12345-0@lo:400:kworker.0 Request processed in 43us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969253.234599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00080000:2.0:1783969253.234751:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff4e00 x1870627099206272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969253.234764:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099206272:0@lo:400:kworker.0 00010000:00080000:2.0:1783969253.234776:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff4380 x1870627099206784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969253.234783:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099206784:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.235805:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099206016 00000100:00100000:0.0:1783969253.235814:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099206016 00000100:00100000:0.0:1783969253.235838:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099205760 00000100:00100000:0.0:1783969253.235841:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099205760 00000100:00100000:0.0:1783969253.235855:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783969253.235863:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099206016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.235916:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099206016:12345-0@lo:400:kworker.0 Request processed in 53us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969253.235922:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783969253.235936:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783969253.235941:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099205760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.235986:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099205760:12345-0@lo:400:kworker.0 Request processed in 45us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969253.235992:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783969253.236013:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099206528 00000100:00100000:0.0:1783969253.236016:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099206528 00000100:00100000:0.0:1783969253.236045:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783969253.236051:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099206528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.236081:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099206528:12345-0@lo:400:kworker.0 Request processed in 30us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969253.236087:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783969253.236108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.236135:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099206400:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.236164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.236181:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099206912:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.236199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.236222:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.236242:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099206144:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.236265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.236289:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099206656:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.236309:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969253.236341:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099205504:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.236355:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099206016:0@lo:400:kworker.0 00010000:00080000:0.0:1783969253.236367:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5f80 x1870627099206528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969253.236410:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099206528:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.236430:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099207040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969253.236455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783969253.236496:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783969253.236502:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969253.236514:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099205888 00000100:00100000:0.0:1783969253.236517:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099205888 00000100:00100000:0.0:1783969253.236535:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099205632 00000100:00100000:0.0:1783969253.236538:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099205632 00000100:00100000:2.0:1783969253.236543:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099206400 00000100:00100000:2.0:1783969253.236547:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099206400 00000100:00100000:0.0:1783969253.236547:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099206144 00000100:00100000:0.0:1783969253.236549:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099206144 00000100:00100000:0.0:1783969253.236565:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099206656 00000100:00100000:0.0:1783969253.236568:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099206656 00000100:00100000:0.0:1783969253.236580:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783969253.236585:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099206912 00000100:00100000:0.0:1783969253.236586:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099205888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969253.236588:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099206912 00000100:00100000:2.0:1783969253.236602:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969253.236608:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099206400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.236622:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099205888:12345-0@lo:400:kworker.0 Request processed in 36us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969253.236827:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099206400:12345-0@lo:400:kworker.0 Request processed in 219us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969253.236841:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969253.236854:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783969253.236860:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099206912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969253.236888:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099206912:12345-0@lo:400:kworker.0 Request processed in 28us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969253.236894:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783969253.237259:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783969253.237276:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783969253.237283:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099205632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.237323:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099205632:12345-0@lo:400:kworker.0 Request processed in 40us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969253.237328:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783969253.237339:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783969253.237345:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099206144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.237371:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099206144:12345-0@lo:400:kworker.0 Request processed in 27us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969253.237413:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783969253.237425:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783969253.237431:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099206656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.237461:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099206656:12345-0@lo:400:kworker.0 Request processed in 31us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969253.237467:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783969253.237576:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099207040 00000100:00100000:0.0:1783969253.237581:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099207040 00000100:00100000:0.0:1783969253.237607:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783969253.237613:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099207040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969253.237691:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969253.237893:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099207040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 279us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969253.237900:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1783969253.237917:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969253.237921:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783969253.237923:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969253.237959:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099205888:0@lo:400:kworker.0 00010000:00080000:0.0:1783969253.237973:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5c00 x1870627099206400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969253.237983:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099206400:0@lo:400:kworker.0 00010000:00080000:0.0:1783969253.237993:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6300 x1870627099206912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969253.238000:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099206912:0@lo:400:kworker.0 00010000:00080000:0.0:1783969253.238043:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8e966d80 x1870627099207040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969253.238057:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099207040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969253.238069:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099205632:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.238078:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099206144:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.238087:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099206656:0@lo:400:kworker.0 00000100:00100000:0.0:1783969253.238131:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099205760:0@lo:400:kworker.0 00000100:00100000:1.0:1783969253.744591:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969253.744616:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099207168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969253.744685:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969253.744749:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099207168 00000100:00100000:1.0:1783969253.744755:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099207168 00000100:00100000:1.0:1783969253.744804:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783969253.744812:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099207168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969253.744842:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969253.744884:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099207168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969253.744891:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1783969253.744931:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8e964a80 x1870627099207168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969253.744950:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099207168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969253.746927:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099207296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969253.746990:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969253.747088:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099207296 00000100:00100000:1.0:1783969253.747095:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099207296 00000100:00100000:1.0:1783969253.747140:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783969253.747149:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099207296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969253.747172:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969253.747222:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099207296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969253.747238:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1783969253.747284:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8e964a80 x1870627099207296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969253.747301:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099207296:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783969254.197715:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969255.180344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969255.180433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969255.180485:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969255.180517:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969255.180535:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969255.180555:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969255.180578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969255.180607:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073964672 00000100:00100000:0.0:1783969255.180616:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073964672 00000100:00100000:0.0:1783969255.180672:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073964928 00000100:00100000:0.0:1783969255.180675:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073964928 00000100:00100000:0.0:1783969255.180690:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073964544 00000100:00100000:0.0:1783969255.180692:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073964544 00000100:00100000:0.0:1783969255.180708:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073964800 00000100:00100000:0.0:1783969255.180711:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073964800 00000100:00100000:0.0:1783969255.180748:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:0.0:1783969255.180758:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073964672:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969255.180805:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:1.0:1783969255.180817:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2394:x1870627073964928:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969255.180837:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073964672:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 79us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969255.180845:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:1.0:1783969255.180859:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2394:x1870627073964928:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 43us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969255.180867:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:2.0:1783969255.180939:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073964416 00000100:00100000:2.0:1783969255.180943:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073964416 00000100:00100000:2.0:1783969255.180975:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 307 00000100:00100000:2.0:1783969255.180982:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2394:x1870627073964416:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969255.181007:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2394:x1870627073964416:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969255.181012:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 307 00000100:00100000:2.0:1783969255.181040:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073965184 00000100:00100000:2.0:1783969255.181043:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073965184 00000100:00100000:2.0:1783969255.181065:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073965056 00000100:00100000:2.0:1783969255.181067:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073965056 00000100:00100000:2.0:1783969255.181085:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1783969255.181091:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2394:x1870627073965184:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969255.181115:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2394:x1870627073965184:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969255.181121:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1783969255.181132:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:2.0:1783969255.181139:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2394:x1870627073965056:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969255.181161:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2394:x1870627073965056:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969255.181174:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00080000:2.0:1783969255.181362:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969255.181368:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969255.181370:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969255.181372:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969255.181443:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2394:x1870627073964544:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969255.181493:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2394:x1870627073964544:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 617us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969255.188758:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:1.0:1783969255.188811:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:1.0:1783969255.188830:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2394:x1870627073964800:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969255.188909:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2394:x1870627073964800:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 89us (8353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969255.188917:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:0.0:1783969255.191112:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 150 00010000:00010000:2.0:1783969255.217584:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783969255.812992:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000001:00100000:3.0:1783969255.813205:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000001:00100000:3.0:1783969255.814239:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000001:00100000:0.0:1783969255.819109:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000001:02000400:2.0:1783969256.060058:0:12191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1783969256.244883:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969257.266637:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969257.329112:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969257.329136:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099207424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969257.329205:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969257.329320:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099207424 00000100:00100000:1.0:1783969257.329328:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099207424 00000100:00100000:1.0:1783969257.329399:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783969257.329410:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099207424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969257.329455:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969257.329521:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099207424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969257.329528:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783969257.329585:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099207424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969257.840996:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969257.841022:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099207552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969257.841094:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969257.841879:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099207552 00000100:00100000:2.0:1783969257.841890:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099207552 00000100:00100000:2.0:1783969257.841947:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783969257.841956:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099207552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969257.841994:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969257.842061:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099207552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969257.842068:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783969257.842228:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099207552:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783969258.288536:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969258.354429:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969258.354452:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099207680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969258.354521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969258.354591:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099207808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969258.354591:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099207680 00000100:00100000:1.0:1783969258.354599:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099207680 00000100:00100000:3.0:1783969258.354628:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.354651:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099207808 00000100:00100000:1.0:1783969258.354655:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099207808 00000100:00100000:1.0:1783969258.354677:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783969258.354685:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783969258.354687:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaba0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099207680:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969258.354698:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099207808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969258.354720:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1783969258.354720:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969258.354774:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099207808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969258.354783:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783969258.354794:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaba0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099207680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969258.354801:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1783969258.354825:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983708700 x1870627099207808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969258.354845:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099207808:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783969258.354997:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969258.355009:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099208064:0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783969258.355060:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8e964a80 x1870627099207680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969258.355071:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099207680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969258.355082:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099208576:0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.355119:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099209088:0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355137:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.355152:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783969258.355156:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099208192:0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.355218:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099208704:0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.355233:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099207936:0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.355251:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099209216:0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.355265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.355269:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969258.355287:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099208448:0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355295:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099208064 00000100:00100000:1.0:1783969258.355297:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099208064 00000100:00100000:3.0:1783969258.355316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.355317:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099208576 00000100:00100000:1.0:1783969258.355319:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099208576 00000100:00100000:3.0:1783969258.355332:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099208960:0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355335:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099209088 00000100:00100000:1.0:1783969258.355337:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099209088 00000100:00100000:1.0:1783969258.355347:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099208704 00000100:00100000:1.0:1783969258.355349:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099208704 00000100:00100000:3.0:1783969258.355352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.355360:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099209216 00000100:00100000:1.0:1783969258.355362:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099209216 00000100:00100000:3.0:1783969258.355370:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783969258.355375:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099208320:0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355375:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783969258.355410:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099208064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.355426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969258.355438:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099208832:0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355444:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099208064:12345-0@lo:400:kworker.0 Request processed in 64us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969258.355450:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783969258.355456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.355461:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099208320 00000100:00100000:1.0:1783969258.355464:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099208320 00000100:00100000:1.0:1783969258.355477:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783969258.355479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099207936 00000100:00100000:3.0:1783969258.355482:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099207936 00000100:00100000:1.0:1783969258.355482:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099208576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.355507:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1783969258.355508:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099208576:12345-0@lo:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969258.355513:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099207936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355513:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783969258.355523:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783969258.355535:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099209088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.355540:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099207936:12345-0@lo:400:kworker.0 Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969258.355545:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1783969258.355557:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099209088:12345-0@lo:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969258.355563:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783969258.355569:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783969258.355572:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783969258.355575:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099208704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969258.355576:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099209216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.355599:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099208704:12345-0@lo:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969258.355599:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099209216:12345-0@lo:400:kworker.0 Request processed in 22us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969258.355605:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783969258.355651:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099208192 00000100:00100000:2.0:1783969258.355655:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099208192 00000100:00100000:2.0:1783969258.355673:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099208448 00000100:00100000:2.0:1783969258.355675:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099208448 00000100:00100000:2.0:1783969258.355696:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783969258.355702:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099208192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969258.355734:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099208192:12345-0@lo:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969258.355740:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783969258.355753:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783969258.355758:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099208448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969258.355806:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099208448:12345-0@lo:400:kworker.0 Request processed in 48us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969258.355812:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783969258.357111:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099208960 00000100:00100000:2.0:1783969258.357122:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099208960 00000100:00100000:2.0:1783969258.357165:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099208832 00000100:00100000:2.0:1783969258.357169:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099208832 00000100:00100000:2.0:1783969258.357192:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969258.357202:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099208960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969258.357272:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099208960:12345-0@lo:400:kworker.0 Request processed in 73us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969258.357280:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969258.357294:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783969258.357300:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099208832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969258.357324:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099208832:12345-0@lo:400:kworker.0 Request processed in 24us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969258.357330:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783969258.360073:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783969258.360104:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783969258.360116:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099208320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.360195:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099208320:12345-0@lo:400:kworker.0 Request processed in 84us (4767us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969258.360202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783969258.360270:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099208320:0@lo:400:kworker.0 00010000:00080000:3.0:1783969258.360287:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6a00 x1870627099208832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969258.360297:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099208832:0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.360308:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099207936:0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.360321:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099208448:0@lo:400:kworker.0 00010000:00080000:3.0:1783969258.360332:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6300 x1870627099208960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969258.360340:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099208960:0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.363091:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099208192:0@lo:400:kworker.0 00010000:00080000:3.0:1783969258.363112:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5500 x1870627099208704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969258.363123:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099208704:0@lo:400:kworker.0 00010000:00080000:3.0:1783969258.363136:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff4a80 x1870627099209216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969258.363144:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099209216:0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.363158:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099208576:0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.363170:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099209088:0@lo:400:kworker.0 00000100:00100000:3.0:1783969258.363183:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099208064:0@lo:400:kworker.0 00000100:00080000:3.0:1783969258.363241:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969258.363268:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969258.363271:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969258.866794:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099209344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969258.866879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969258.871799:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969258.871846:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099209344 00000100:00100000:3.0:1783969258.871855:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099209344 00000100:00100000:3.0:1783969258.871909:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783969258.871919:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099209344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969258.871949:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969258.872079:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099209472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969258.872122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969258.872187:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099209344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 269us (5307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969258.872195:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783969258.872223:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099209472 00000100:00100000:3.0:1783969258.872227:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099209472 00000100:00100000:3.0:1783969258.872245:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783969258.872251:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099209472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969258.872261:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969258.872285:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099209472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969258.872291:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1783969258.873078:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5f80 x1870627099209344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969258.873101:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099209344:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1783969258.873215:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983709500 x1870627099209472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969258.873230:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099209472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783969259.315874:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969260.319258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969260.319423:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073965312 00000100:00100000:2.0:1783969260.319434:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073965312 00000100:00100000:0.0:1783969260.319930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969260.319966:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969260.319990:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969260.320020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969260.320066:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073965952 00000100:00100000:0.0:1783969260.320071:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073965952 00000100:00100000:0.0:1783969260.320116:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:0.0:1783969260.320128:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073965952:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969260.320198:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073965952:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969260.320206:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00080000:0.0:1783969260.320408:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969260.320421:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073965440 00000100:00100000:0.0:1783969260.320425:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073965440 00000100:00100000:0.0:1783969260.320454:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073965696 00000100:00100000:0.0:1783969260.320463:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073965696 00000100:00100000:0.0:1783969260.320483:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073965568 00000100:00100000:0.0:1783969260.320486:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073965568 00000100:00100000:0.0:1783969260.320501:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:0.0:1783969260.320508:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073965440:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969260.320541:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073965440:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 33us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969260.320548:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:0.0:1783969260.320560:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:0.0:1783969260.320566:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073965696:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969260.320591:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073965696:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969260.320597:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:0.0:1783969260.320610:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 160 00000100:00100000:0.0:1783969260.320616:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073965568:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969260.320782:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 309 00000100:00100000:2.0:1783969260.320791:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073965312:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969260.320820:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073965312:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969260.320826:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 309 00000100:00100000:0.0:1783969260.320933:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073965568:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 317us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969260.320940:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 160 00000100:00080000:0.0:1783969260.320959:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969260.320962:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969260.324841:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969260.324924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969260.325004:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073966080 00000100:00100000:3.0:1783969260.325014:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073966080 00000100:00100000:3.0:1783969260.325078:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:3.0:1783969260.325085:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073966080:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969260.325140:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073966080:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 57us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969260.325145:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00080000:0.0:1783969260.326546:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969260.328718:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073965824 00000100:00100000:2.0:1783969260.328731:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073965824 00000100:00100000:2.0:1783969260.328820:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 161 00000100:00100000:2.0:1783969260.328832:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073965824:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:0.0:1783969260.330223:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969260.330401:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073965824:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 1566us (5563us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969260.330412:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 161 00010000:00010000:0.0:1783969260.337129:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969261.362010:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969262.390515:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969262.451081:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969262.451107:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099209600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969262.451192:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969262.451348:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099209600 00000100:00100000:2.0:1783969262.451356:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099209600 00000100:00100000:2.0:1783969262.451702:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783969262.451712:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099209600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783969262.451749:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783969262.453498:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099209600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1781us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969262.453523:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783969262.457793:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099209600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969262.960782:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099209728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969262.960861:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969262.960996:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099209728 00000100:00100000:0.0:1783969262.961004:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099209728 00000100:00100000:0.0:1783969262.961049:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783969262.961057:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099209728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783969262.961090:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783969262.961143:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099209728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969262.961150:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783969262.961370:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099209728:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783969263.414735:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969263.476278:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099209984:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476360:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476423:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099210496:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476461:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476485:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099211008:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476529:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1783969263.476535:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099209856:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476586:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099210368:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476623:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099210880:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476674:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099211392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969263.476696:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476722:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099210112:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476762:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099210624:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476800:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099211136:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476836:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783969263.476842:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099210240:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476863:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476873:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099210752:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476917:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099211264:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.476956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.476990:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099209984 00000100:00100000:1.0:1783969263.476997:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099209984 00000100:00100000:1.0:1783969263.477038:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099210496 00000100:00100000:1.0:1783969263.477041:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099210496 00000100:00100000:1.0:1783969263.477059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099211008 00000100:00100000:1.0:1783969263.477061:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099211008 00000100:00100000:1.0:1783969263.477071:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099210368 00000100:00100000:1.0:1783969263.477073:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099210368 00000100:00100000:1.0:1783969263.477084:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099210880 00000100:00100000:1.0:1783969263.477086:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099210880 00000100:00100000:1.0:1783969263.477095:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099210240 00000100:00100000:1.0:1783969263.477097:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099210240 00000100:00100000:1.0:1783969263.477109:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783969263.477117:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099209984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477168:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099209984:12345-0@lo:400:kworker.0 Request processed in 51us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477175:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783969263.477191:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783969263.477197:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099210496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477225:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099210496:12345-0@lo:400:kworker.0 Request processed in 28us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783969263.477240:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783969263.477246:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099211008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477271:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099211008:12345-0@lo:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477276:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783969263.477298:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783969263.477304:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099210368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477345:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099210368:12345-0@lo:400:kworker.0 Request processed in 42us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477351:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783969263.477362:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783969263.477368:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099210880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477416:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099210880:12345-0@lo:400:kworker.0 Request processed in 48us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477422:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783969263.477432:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783969263.477439:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099210240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477469:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099210240:12345-0@lo:400:kworker.0 Request processed in 31us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477475:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783969263.477496:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099209856 00000100:00100000:1.0:1783969263.477499:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099209856 00000100:00100000:1.0:1783969263.477522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1783969263.477528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099209856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477556:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099209856:12345-0@lo:400:kworker.0 Request processed in 28us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477563:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1783969263.477599:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099211392 00000100:00100000:1.0:1783969263.477603:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099211392 00000100:00100000:1.0:1783969263.477628:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783969263.477635:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099211392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969263.477665:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969263.477698:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099211392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477704:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783969263.477719:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099210624 00000100:00100000:1.0:1783969263.477723:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099210624 00000100:00100000:1.0:1783969263.477739:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099211136 00000100:00100000:1.0:1783969263.477741:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099211136 00000100:00100000:1.0:1783969263.477748:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099210752 00000100:00100000:1.0:1783969263.477749:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099210752 00000100:00100000:1.0:1783969263.477757:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099211264 00000100:00100000:1.0:1783969263.477759:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099211264 00000100:00100000:1.0:1783969263.477769:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783969263.477774:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099210624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477799:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099210624:12345-0@lo:400:kworker.0 Request processed in 25us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477804:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783969263.477812:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783969263.477817:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099211136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477834:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099211136:12345-0@lo:400:kworker.0 Request processed in 17us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477839:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783969263.477846:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783969263.477851:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099210752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477868:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099210752:12345-0@lo:400:kworker.0 Request processed in 17us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477873:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783969263.477888:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783969263.477892:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099211264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.477916:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099211264:12345-0@lo:400:kworker.0 Request processed in 24us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.477922:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783969263.477957:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099210240:0@lo:400:kworker.0 00010000:00080000:1.0:1783969263.477968:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981acb480 x1870627099210752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969263.477978:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099210752:0@lo:400:kworker.0 00010000:00080000:1.0:1783969263.477987:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981aca680 x1870627099211264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969263.477994:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099211264:0@lo:400:kworker.0 00010000:00080000:1.0:1783969263.478003:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981ac8000 x1870627099210624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969263.478010:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099210624:0@lo:400:kworker.0 00010000:00080000:1.0:1783969263.478018:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981ac9180 x1870627099211136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969263.478026:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099211136:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.478052:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e966680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099209856:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.478060:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099210368:0@lo:400:kworker.0 00000100:00100000:1.0:1783969263.478069:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099210880:0@lo:400:kworker.0 00010000:00080000:1.0:1783969263.478077:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981ac8a80 x1870627099211392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969263.478094:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099211392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969263.478105:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099209984:0@lo:400:kworker.0 00010000:00080000:1.0:1783969263.478113:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319e680 x1870627099210496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969263.478120:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099210496:0@lo:400:kworker.0 00010000:00080000:1.0:1783969263.478129:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981acb100 x1870627099211008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969263.478137:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099211008:0@lo:400:kworker.0 00000100:00100000:0.0:1783969263.478352:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099210112 00000100:00100000:0.0:1783969263.478357:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099210112 00000100:00100000:0.0:1783969263.478395:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783969263.478402:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099210112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969263.478440:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099210112:12345-0@lo:400:kworker.0 Request processed in 39us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969263.478451:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1783969263.478474:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783969263.478478:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969263.478480:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969263.478482:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969263.478772:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099210112:0@lo:400:kworker.0 00000100:00100000:0.0:1783969263.480271:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969263.480290:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099211520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969263.480361:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969263.480566:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099211520 00000100:00100000:3.0:1783969263.480573:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099211520 00000100:00100000:3.0:1783969263.480636:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783969263.480644:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099211520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969263.480666:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969263.480707:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099211520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969263.480713:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1783969263.480786:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779fb80 x1870627099211520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969263.480803:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099211520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969263.984721:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099211648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969263.984795:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969263.984945:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099211648 00000100:00100000:3.0:1783969263.984953:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099211648 00000100:00100000:3.0:1783969263.985017:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783969263.985027:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099211648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969263.985056:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969263.985112:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099211648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969263.985120:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1783969263.985204:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983709880 x1870627099211648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969263.985224:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099211648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969263.991844:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099211776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969263.991920:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969263.992133:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099211776 00000100:00100000:1.0:1783969263.992142:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099211776 00000100:00100000:1.0:1783969263.992198:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783969263.992207:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099211776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969263.992229:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969263.992274:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099211776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969263.992283:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1783969263.992374:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319e680 x1870627099211776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969263.992584:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099211776:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1783969264.149152:0:12521:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783969264.149495:0:12521:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783969264.432625:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969265.423447:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969265.423486:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969265.423505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969265.423524:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969265.423540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969265.423555:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969265.423575:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969265.423600:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073966464 00000100:00100000:3.0:1783969265.423608:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073966464 00000100:00100000:3.0:1783969265.423661:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073966720 00000100:00100000:3.0:1783969265.423663:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073966720 00000100:00100000:3.0:1783969265.423675:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073966336 00000100:00100000:3.0:1783969265.423677:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073966336 00000100:00100000:3.0:1783969265.423687:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073966592 00000100:00100000:3.0:1783969265.423701:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073966592 00000100:00100000:3.0:1783969265.423722:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:3.0:1783969265.423897:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073966464:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969265.423963:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073966464:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 71us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969265.423970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:3.0:1783969265.423986:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:3.0:1783969265.423992:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073966720:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969265.424013:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073966720:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969265.424019:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:3.0:1783969265.424028:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:3.0:1783969265.424033:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627073966336:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969265.424050:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627073966336:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 17us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969265.424054:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:3.0:1783969265.424062:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:3.0:1783969265.424067:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073966592:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969265.424082:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073966592:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 15us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969265.424087:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:3.0:1783969265.424916:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073966976 00000100:00100000:3.0:1783969265.424924:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073966976 00000100:00100000:3.0:1783969265.424956:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073966848 00000100:00100000:3.0:1783969265.424968:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073966848 00000100:00100000:3.0:1783969265.424998:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:3.0:1783969265.425006:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073966976:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969265.425049:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073966976:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 44us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969265.425055:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:3.0:1783969265.425067:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:3.0:1783969265.425072:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073966848:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969265.425535:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073966208 00000100:00100000:2.0:1783969265.425540:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073966208 00000100:00100000:2.0:1783969265.425576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 311 00000100:00100000:2.0:1783969265.425582:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2393:x1870627073966208:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969265.425613:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2393:x1870627073966208:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 31us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969265.425631:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 311 00000100:00100000:3.0:1783969265.426196:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073966848:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 1121us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969265.426205:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00080000:0.0:1783969265.426885:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783969265.426891:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969265.426895:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969265.426897:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783969265.457905:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969266.481753:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783969266.511823:0:12618:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969266.512048:0:12618:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783969267.504530:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969267.573467:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099211904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969267.573586:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969267.573677:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099211904 00000100:00100000:1.0:1783969267.573684:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099211904 00000100:00100000:1.0:1783969267.573730:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783969267.573738:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099211904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969267.573794:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969267.573841:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099211904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969267.573849:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783969267.573893:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099211904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969268.084539:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099212032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969268.084604:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969268.084668:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099212032 00000100:00100000:2.0:1783969268.084675:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099212032 00000100:00100000:2.0:1783969268.084715:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969268.084723:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099212032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969268.084755:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969268.084830:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099212032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969268.084837:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969268.084876:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099212032:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783969268.528715:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969268.596325:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099212416:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.596439:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969268.596483:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099212928:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.596507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969268.596527:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099213440:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.596545:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969268.596571:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783969268.596576:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099212544:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.596616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969268.596631:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099213056:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.596651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969268.596678:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099213568:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.596698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969268.596729:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099212416 00000100:00100000:2.0:1783969268.596735:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099212416 00000100:00100000:2.0:1783969268.596779:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783969268.596788:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099212416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.596836:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099212416:12345-0@lo:400:kworker.0 Request processed in 48us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969268.596842:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783969268.596864:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099212928 00000100:00100000:2.0:1783969268.596868:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099212928 00000100:00100000:2.0:1783969268.596893:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099213440 00000100:00100000:2.0:1783969268.596913:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099213440 00000100:00100000:2.0:1783969268.596929:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099213056 00000100:00100000:2.0:1783969268.596931:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099213056 00000100:00100000:2.0:1783969268.596941:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099213568 00000100:00100000:2.0:1783969268.596943:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099213568 00000100:00100000:2.0:1783969268.596954:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783969268.596959:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099212928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.596990:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099212928:12345-0@lo:400:kworker.0 Request processed in 29us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969268.596995:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783969268.597007:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783969268.597012:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099213440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.597036:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099213440:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969268.597042:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783969268.597052:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783969268.597064:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099213056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.597087:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099213056:12345-0@lo:400:kworker.0 Request processed in 24us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969268.597091:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783969268.597102:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783969268.597107:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099213568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.597130:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099213568:12345-0@lo:400:kworker.0 Request processed in 23us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969268.597136:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1783969268.597175:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6a00 x1870627099213056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969268.597189:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099213056:0@lo:400:kworker.0 00010000:00080000:2.0:1783969268.597200:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e982421c00 x1870627099213568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969268.597208:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099213568:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.597218:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099212416:0@lo:400:kworker.0 00010000:00080000:2.0:1783969268.597227:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff6300 x1870627099212928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969268.597233:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099212928:0@lo:400:kworker.0 00010000:00080000:2.0:1783969268.597253:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e982421f80 x1870627099213440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969268.597261:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099213440:0@lo:400:kworker.0 00000100:00080000:2.0:1783969268.597291:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969268.597300:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969268.597354:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099212288:0@lo:400:kworker.0 00000100:00100000:1.0:1783969268.597420:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969268.597554:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099212160:0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.597591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969268.597626:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099212672:0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.597649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969268.597667:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099213184:0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.597686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969268.597728:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099212544 00000100:00100000:3.0:1783969268.597732:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099212544 00000100:00100000:3.0:1783969268.597758:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099212288 00000100:00100000:3.0:1783969268.597760:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099212288 00000100:00100000:3.0:1783969268.597770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099212672 00000100:00100000:3.0:1783969268.597772:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099212672 00000100:00100000:3.0:1783969268.597796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099213184 00000100:00100000:3.0:1783969268.597799:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099213184 00000100:00100000:3.0:1783969268.597812:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783969268.597817:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099212544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.597854:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099212544:12345-0@lo:400:kworker.0 Request processed in 37us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969268.597860:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783969268.597871:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783969268.597877:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099212288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.597902:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099212288:12345-0@lo:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969268.597907:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783969268.597917:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783969268.597922:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099212672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.597944:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099212672:12345-0@lo:400:kworker.0 Request processed in 23us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969268.597949:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783969268.597958:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783969268.597963:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099213184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.597985:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099213184:12345-0@lo:400:kworker.0 Request processed in 22us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969268.597991:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1783969268.598012:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969268.598030:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099212544:0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.598047:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099213696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969268.598099:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969268.598127:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099212672:0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.598136:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099213184:0@lo:400:kworker.0 00000100:00100000:3.0:1783969268.598158:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099213696 00000100:00100000:3.0:1783969268.598162:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099213696 00000100:00100000:3.0:1783969268.598186:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783969268.598198:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099213696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783969268.598222:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969268.598269:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099213696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969268.598274:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1783969268.598300:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779e300 x1870627099213696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969268.598314:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099213696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969268.598377:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099212160 00000100:00100000:1.0:1783969268.598405:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099212160 00000100:00100000:1.0:1783969268.598434:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1783969268.598441:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099212160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969268.598473:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099212160:12345-0@lo:400:kworker.0 Request processed in 33us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969268.598479:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1783969268.598612:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099212160:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.598917:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099212288:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.598925:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099212800:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.598950:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969268.599097:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099213312:0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.599120:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969268.599150:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099213824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969268.599167:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099212800 00000100:00100000:0.0:1783969268.599171:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099212800 00000100:00100000:2.0:1783969268.599172:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969268.599199:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099213312 00000100:00100000:0.0:1783969268.599202:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099213312 00000100:00100000:0.0:1783969268.599223:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783969268.599229:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099212800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.599244:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783969268.599252:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099213312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969268.599280:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099213312:12345-0@lo:400:kworker.0 Request processed in 29us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969268.599280:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099212800:12345-0@lo:400:kworker.0 Request processed in 51us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969268.599287:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1783969268.599324:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969268.599770:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783969268.599789:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099213824 00000100:00100000:0.0:1783969268.599793:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099213824 00000100:00100000:0.0:1783969268.599840:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783969268.599847:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099213824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969268.599861:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969268.599891:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099213824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969268.599895:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1783969268.599915:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779f800 x1870627099213824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969268.599926:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099213824:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783969268.599933:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff5500 x1870627099212800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969268.599938:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099212800:0@lo:400:kworker.0 00010000:00080000:0.0:1783969268.599943:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e982423480 x1870627099213312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969268.599959:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099213312:0@lo:400:kworker.0 00000020:00000004:3.0:1783969268.639999:0:12715:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969268.640264:0:12715:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783969269.106627:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969269.106650:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099213952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969269.106716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969269.106783:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099213952 00000100:00100000:0.0:1783969269.106790:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099213952 00000100:00100000:0.0:1783969269.106837:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783969269.106846:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099213952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969269.106873:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969269.106918:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099213952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969269.106925:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1783969269.106968:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779f800 x1870627099213952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969269.106985:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099213952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969269.107440:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099214080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969269.107468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969269.107644:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099214080 00000100:00100000:3.0:1783969269.107649:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099214080 00000100:00100000:3.0:1783969269.107685:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783969269.107692:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099214080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969269.107815:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969269.107862:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099214080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969269.107877:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1783969269.108289:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983710700 x1870627099214080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969269.108304:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099214080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783969269.553661:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969270.540213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969270.540261:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969270.540378:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073967744 00000100:00100000:0.0:1783969270.540408:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073967744 00000100:00100000:0.0:1783969270.540465:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073967872 00000100:00100000:0.0:1783969270.540467:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073967872 00000100:00100000:0.0:1783969270.540493:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1783969270.540503:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2390:x1870627073967744:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:0.0:1783969270.540542:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9bd7 00000100:00080000:0.0:1783969270.540560:0:8437:0:(import.c:65:import_set_state_nolock()) ffff93eabf7e1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783969270.540604:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783969270.540894:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:3.0:1783969270.540905:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2390:x1870627073967872:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:3.0:1783969270.540920:0:9974:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9bde 00000100:00080000:3.0:1783969270.540926:0:9974:0:(import.c:65:import_set_state_nolock()) ffff93eabf7e6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783969270.540957:0:9974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:1.0:1783969270.543814:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969270.543825:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969270.543948:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+2:2390:x1870627073967744:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 3438us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969270.543963:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00010000:00010000:0.0:1783969270.544021:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969270.544036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969270.545664:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+2:2390:x1870627073967872:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 4754us (5395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969270.545677:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1783969270.546407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969270.546495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969270.546788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969270.546809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969270.546828:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969270.546955:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073967104 00000100:00100000:3.0:1783969270.546964:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073967104 00000100:00100000:3.0:1783969270.547009:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 313 00000100:00100000:3.0:1783969270.547020:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073967104:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969270.549099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073967360 00000100:00100000:0.0:1783969270.549112:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073967360 00000100:00100000:0.0:1783969270.549163:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073967616 00000100:00100000:0.0:1783969270.549166:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073967616 00000100:00100000:0.0:1783969270.549181:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073967232 00000100:00100000:0.0:1783969270.549183:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073967232 00000100:00100000:0.0:1783969270.549195:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073967488 00000100:00100000:0.0:1783969270.549198:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073967488 00000100:00100000:0.0:1783969270.551770:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 178 00000100:00100000:0.0:1783969270.551789:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073967360:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969270.552129:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073967104:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 5107us (5721us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969270.552140:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 313 00000100:00080000:1.0:1783969270.555590:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969270.555600:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969270.556402:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073967360:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 4594us (9879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969270.556419:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 178 00000100:00100000:0.0:1783969270.556457:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:0.0:1783969270.556471:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073967616:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969270.556702:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:1.0:1783969270.556713:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073967232:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969270.557355:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073967616:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 878us (10555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969270.557364:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:0.0:1783969270.557406:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:0.0:1783969270.557415:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073967488:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969270.559650:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073967232:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 2929us (12828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969270.559678:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:0.0:1783969270.560048:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073967488:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 2633us (13217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969270.560057:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 181 00010000:00010000:0.0:1783969270.576685:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783969270.829072:0:12813:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969270.829413:0:12813:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783969271.602217:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969272.624660:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969272.692092:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969272.692117:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099214208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969272.692198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969272.692568:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099214208 00000100:00100000:0.0:1783969272.692576:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099214208 00000100:00100000:0.0:1783969272.692628:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783969272.692638:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099214208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969272.692672:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783969272.692725:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099214208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969272.692732:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783969272.692780:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099214208:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1783969272.856339:0:12911:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969272.856601:0:12911:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783969273.200835:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099214336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969273.200913:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969273.201086:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099214336 00000100:00100000:2.0:1783969273.201094:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099214336 00000100:00100000:2.0:1783969273.201146:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783969273.201156:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099214336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969273.201205:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969273.201261:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099214336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969273.201281:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783969273.202649:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099214336:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783969273.650332:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969273.713604:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099214720:0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.713674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969273.713757:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099214848:0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.713783:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969273.713835:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099215232:0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.713859:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969273.713897:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099215232 00000100:00100000:3.0:1783969273.713904:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099215232 00000100:00100000:3.0:1783969273.713952:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783969273.713960:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099215232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.714003:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099215232:12345-0@lo:400:kworker.0 Request processed in 44us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969273.714009:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1783969273.714026:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783969273.714064:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734ca80 x1870627099215232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969273.714079:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099215232:0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.714114:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099215360:0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.714136:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969273.714175:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099215360 00000100:00100000:3.0:1783969273.714179:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099215360 00000100:00100000:3.0:1783969273.714203:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783969273.714209:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099215360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714352:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099214464:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969273.714428:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099214976:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714450:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969273.714468:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783969273.714473:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099214592:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714494:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969273.714510:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099215104:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714529:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969273.714555:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099214720 00000100:00100000:2.0:1783969273.714558:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099214720 00000100:00100000:2.0:1783969273.714586:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783969273.714592:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099214720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714630:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099214720:12345-0@lo:400:kworker.0 Request processed in 38us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969273.714636:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783969273.714656:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099214848 00000100:00100000:2.0:1783969273.714659:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099214848 00000100:00100000:2.0:1783969273.714681:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099214976 00000100:00100000:2.0:1783969273.714684:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099214976 00000100:00100000:2.0:1783969273.714696:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099214592 00000100:00100000:2.0:1783969273.714698:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099214592 00000100:00100000:2.0:1783969273.714709:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099215104 00000100:00100000:2.0:1783969273.714711:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099215104 00000100:00100000:2.0:1783969273.714724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783969273.714730:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099214848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714773:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099214848:12345-0@lo:400:kworker.0 Request processed in 42us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969273.714779:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783969273.714791:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783969273.714797:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099214976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714827:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099214976:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969273.714833:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783969273.714843:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783969273.714849:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099214592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714890:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099214592:12345-0@lo:400:kworker.0 Request processed in 41us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969273.714895:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783969273.714905:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783969273.714910:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099215104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.714933:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099215104:12345-0@lo:400:kworker.0 Request processed in 23us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969273.714938:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783969273.714953:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099214464 00000100:00100000:2.0:1783969273.714956:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099214464 00000100:00100000:2.0:1783969273.714978:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1783969273.714983:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099214464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.715008:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099214464:12345-0@lo:400:kworker.0 Request processed in 25us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969273.715014:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1783969273.715057:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099214720:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.715092:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099214848:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.715112:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099214592:0@lo:400:kworker.0 00010000:00080000:2.0:1783969273.715121:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734d180 x1870627099215104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969273.715130:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099215104:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.715138:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099214464:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.715145:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099214976:0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.715522:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099215360:12345-0@lo:400:kworker.0 Request processed in 1312us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969273.715531:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1783969273.715551:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969273.715554:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969273.715557:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969273.715597:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099215488:0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.715626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969273.715662:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969273.715668:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099215616:0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.715698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969273.715719:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099215488 00000100:00100000:3.0:1783969273.715722:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099215488 00000100:00100000:3.0:1783969273.715746:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099215616 00000100:00100000:3.0:1783969273.715749:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099215616 00000100:00100000:3.0:1783969273.715762:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783969273.715768:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099215488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.715802:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099215488:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969273.715808:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783969273.715818:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783969273.715824:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099215616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.715848:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099215616:12345-0@lo:400:kworker.0 Request processed in 25us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969273.715854:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1783969273.715866:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969273.715868:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783969273.715883:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff1180 x1870627099215616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969273.715893:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099215616:0@lo:400:kworker.0 00000100:00100000:3.0:1783969273.715903:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099215488:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.716360:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099215872:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.716416:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783969273.716445:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734ca80 x1870627099215360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969273.716455:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099215360:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.716467:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969273.716471:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099215744:0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.716495:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969273.716519:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099215872 00000100:00100000:2.0:1783969273.716523:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099215872 00000100:00100000:2.0:1783969273.716549:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099215744 00000100:00100000:2.0:1783969273.716551:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099215744 00000100:00100000:2.0:1783969273.716567:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783969273.716572:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099215872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.716602:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099215872:12345-0@lo:400:kworker.0 Request processed in 30us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969273.716614:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783969273.716625:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783969273.716630:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099215744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969273.716653:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099215744:12345-0@lo:400:kworker.0 Request processed in 23us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969273.716658:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1783969273.716669:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783969273.716690:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff2d80 x1870627099215744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969273.716700:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099215744:0@lo:400:kworker.0 00010000:00080000:2.0:1783969273.716708:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff1180 x1870627099215872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969273.716715:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099215872:0@lo:400:kworker.0 00000100:00100000:0.0:1783969273.717744:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099216000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969273.717788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969273.717823:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099216000 00000100:00100000:0.0:1783969273.717827:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099216000 00000100:00100000:0.0:1783969273.717857:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783969273.717864:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099216000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969273.717887:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969273.717929:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099216000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969273.717935:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1783969273.717972:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262ea00 x1870627099216000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969273.717986:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099216000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969273.725537:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969273.732932:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099216128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969273.733011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969273.733175:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099216128 00000100:00100000:0.0:1783969273.733184:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099216128 00000100:00100000:0.0:1783969273.733521:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783969273.733531:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099216128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969273.733557:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969273.733606:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099216128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969273.733614:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1783969273.733695:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983710e00 x1870627099216128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969273.733715:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099216128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969274.224615:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099216256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969274.224686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969274.224794:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099216256 00000100:00100000:0.0:1783969274.224802:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099216256 00000100:00100000:0.0:1783969274.224857:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783969274.224866:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099216256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969274.224895:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969274.224938:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099216256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969274.224946:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1783969274.225024:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262ea00 x1870627099216256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969274.225042:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099216256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969274.225222:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969274.225241:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099216384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969274.225271:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969274.225407:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099216384 00000100:00100000:2.0:1783969274.225424:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099216384 00000100:00100000:2.0:1783969274.225450:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783969274.225456:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099216384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969274.225468:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969274.225502:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099216384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969274.225508:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1783969274.225540:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983710700 x1870627099216384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969274.225553:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099216384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783969274.672716:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969275.661623:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969275.661661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969275.661736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969275.661756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969275.661781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969275.661809:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073968128 00000100:00100000:2.0:1783969275.661818:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073968128 00000100:00100000:2.0:1783969275.661873:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073968384 00000100:00100000:2.0:1783969275.661876:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073968384 00000100:00100000:2.0:1783969275.661890:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073968256 00000100:00100000:2.0:1783969275.661892:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073968256 00000100:00100000:2.0:1783969275.661904:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073968512 00000100:00100000:2.0:1783969275.661907:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073968512 00000100:00100000:2.0:1783969275.661921:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:2.0:1783969275.661931:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073968128:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969275.662003:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073968128:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 73us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969275.662022:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:2.0:1783969275.662039:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:2.0:1783969275.662046:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073968384:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969275.662071:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073968384:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969275.662077:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:2.0:1783969275.662087:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:2.0:1783969275.662093:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073968256:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969275.662115:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073968256:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969275.662135:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:2.0:1783969275.662146:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:2.0:1783969275.662152:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073968512:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969275.662175:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073968512:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969275.662182:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:2.0:1783969275.662198:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073968000 00000100:00100000:2.0:1783969275.662201:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073968000 00000100:00100000:2.0:1783969275.662234:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 315 00000100:00100000:2.0:1783969275.662241:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073968000:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969275.662268:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073968000:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969275.662274:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 315 00000100:00080000:2.0:1783969275.662310:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969275.662313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969275.705426:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783969275.780051:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000020:00000080:1.0:1783969275.780060:0:9517:0:(genops.c:906:class_export_put()) final put ffff93eabf7e7800/2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000020:00000080:2.0:1783969275.780869:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eabf7e7800/2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 for lustre-OST0001 00000020:00000080:2.0:1783969275.780919:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eabf7e6000 for lustre-OST0001 00000001:00100000:1.0:1783969275.781531:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000020:00000080:1.0:1783969275.781537:0:8432:0:(genops.c:906:class_export_put()) final put ffff93eabf7e5800/2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000020:00000080:2.0:1783969275.781588:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93eabf7e5800/2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 for lustre-OST0000 00000020:00000080:2.0:1783969275.788904:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eabf7e1000 for lustre-OST0000 00010000:00010000:3.0:1783969276.722611:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969277.745588:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783969277.774506:0:13055:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1783969277.813360:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099216512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969277.813448:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969277.813518:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099216512 00000100:00100000:1.0:1783969277.813526:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099216512 00000100:00100000:1.0:1783969277.813568:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783969277.813576:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099216512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969277.813610:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969277.813654:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099216512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969277.813662:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783969277.813895:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099216512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969278.323049:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969278.323073:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099216640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969278.323172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969278.323649:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099216640 00000100:00100000:2.0:1783969278.323668:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099216640 00000100:00100000:2.0:1783969278.323719:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783969278.323728:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099216640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969278.323760:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969278.323814:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099216640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969278.323821:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783969278.323974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099216640:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783969278.768789:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969278.832633:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969278.832664:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099216768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969278.832754:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969278.833277:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099216768 00000100:00100000:2.0:1783969278.833286:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099216768 00000100:00100000:2.0:1783969278.833349:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783969278.833361:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099216768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969278.833409:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969278.833454:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099216768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969278.833461:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1783969278.833546:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734e680 x1870627099216768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969278.833564:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099216768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969278.834404:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099216896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969278.834453:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969278.834542:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099216896 00000100:00100000:1.0:1783969278.834548:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099216896 00000100:00100000:1.0:1783969278.834588:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783969278.834594:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099216896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969278.834610:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969278.834656:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099216896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969278.834662:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1783969278.835014:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969278.835447:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099217280:0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.835486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969278.835506:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099217792:0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.835530:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969278.835546:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783969278.835551:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099217408:0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.835575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969278.835599:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099217920:0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.835620:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783969278.835753:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981ac9180 x1870627099216896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969278.835845:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099216896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969278.835963:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099217792 00000100:00100000:2.0:1783969278.835969:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099217792 00000100:00100000:2.0:1783969278.836024:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099217920 00000100:00100000:2.0:1783969278.836027:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099217920 00000100:00100000:2.0:1783969278.836052:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783969278.836060:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099217792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.836273:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099217792:12345-0@lo:400:kworker.0 Request processed in 213us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969278.836280:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783969278.836296:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783969278.836301:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099217920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.836326:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099217920:12345-0@lo:400:kworker.0 Request processed in 26us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969278.836331:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783969278.836346:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099217408 00000100:00100000:2.0:1783969278.836350:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099217408 00000100:00100000:2.0:1783969278.836371:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783969278.836376:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099217408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.836423:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099217408:12345-0@lo:400:kworker.0 Request processed in 47us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969278.836429:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783969278.836450:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099217152:0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.836473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969278.836489:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099217664:0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.836504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969278.836516:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099218176:0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.836534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969278.836548:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783969278.836554:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099217024:0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.836576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969278.836596:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099217536:0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.836625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969278.836641:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099218048:0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.836660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969278.836684:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099217152 00000100:00100000:2.0:1783969278.836688:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099217152 00000100:00100000:2.0:1783969278.836715:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099217664 00000100:00100000:2.0:1783969278.836718:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099217664 00000100:00100000:2.0:1783969278.836731:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099218176 00000100:00100000:2.0:1783969278.836734:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099218176 00000100:00100000:2.0:1783969278.836746:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099217536 00000100:00100000:2.0:1783969278.836748:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099217536 00000100:00100000:2.0:1783969278.836757:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099218048 00000100:00100000:2.0:1783969278.836759:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099218048 00000100:00080000:0.0:1783969278.836957:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969278.836962:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969278.836964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969278.837052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783969278.837061:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099217152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969278.837178:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099217152:12345-0@lo:400:kworker.0 Request processed in 55us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969278.837187:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783969278.837202:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783969278.837208:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099217664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969278.837238:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099217664:12345-0@lo:400:kworker.0 Request processed in 29us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969278.837244:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783969278.837255:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783969278.837261:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099218176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969278.837293:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099218176:12345-0@lo:400:kworker.0 Request processed in 32us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969278.837298:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783969278.837309:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783969278.837407:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099217408:0@lo:400:kworker.0 00010000:00080000:1.0:1783969278.837422:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a46680 x1870627099217920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969278.837444:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099217920:0@lo:400:kworker.0 00010000:00080000:1.0:1783969278.837460:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a45880 x1870627099217792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969278.837470:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099217792:0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.837502:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099217280 00000100:00100000:1.0:1783969278.837505:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099217280 00000100:00100000:1.0:1783969278.837529:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783969278.837535:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099217280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.837569:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099217280:12345-0@lo:400:kworker.0 Request processed in 35us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969278.837575:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783969278.837601:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099217280:0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.837625:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099217024 00000100:00100000:1.0:1783969278.837627:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099217024 00000100:00100000:1.0:1783969278.837649:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783969278.837654:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099217024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.837680:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099217024:12345-0@lo:400:kworker.0 Request processed in 26us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969278.837686:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783969278.837744:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099217024:0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.837755:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099217152:0@lo:400:kworker.0 00000100:00100000:0.0:1783969278.837858:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099217536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969278.837892:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099217536:12345-0@lo:400:kworker.0 Request processed in 572us (1266us total) trans 0 rc 0/0 00010000:00080000:1.0:1783969278.837993:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf747480 x1870627099217664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969278.838014:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099217664:0@lo:400:kworker.0 00010000:00080000:1.0:1783969278.838028:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a45f80 x1870627099218176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969278.838035:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099218176:0@lo:400:kworker.0 00000100:00100000:1.0:1783969278.838054:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099217536:0@lo:400:kworker.0 00000100:00100000:0.0:1783969278.848926:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783969278.852489:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1783969278.852512:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099218048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969278.852619:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099218048:12345-0@lo:400:kworker.0 Request processed in 119us (15957us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969278.852627:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783969278.852922:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099218048:0@lo:400:kworker.0 00000100:00100000:1.0:1783969279.346302:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099218304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969279.346427:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969279.346520:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099218304 00000100:00100000:1.0:1783969279.346529:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099218304 00000100:00100000:1.0:1783969279.346588:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783969279.346598:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099218304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969279.346650:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969279.346699:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099218304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969279.346707:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1783969279.346758:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a45f80 x1870627099218304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969279.346781:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099218304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969279.352140:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969279.357733:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099218432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969279.358250:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969279.360180:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099218432 00000100:00100000:1.0:1783969279.360199:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099218432 00000100:00100000:1.0:1783969279.360276:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783969279.360289:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099218432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969279.360324:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969279.360706:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099218432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 419us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969279.360715:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1783969279.361280:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff0380 x1870627099218432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969279.361310:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099218432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783969279.792753:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969280.782372:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969280.782442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969280.784821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969280.784883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969280.789224:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073968768 00000100:00100000:2.0:1783969280.789244:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073968768 00000100:00080000:2.0:1783969280.789351:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969280.790364:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073969024 00000100:00100000:2.0:1783969280.790373:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073969024 00000100:00100000:2.0:1783969280.790465:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:2.0:1783969280.790476:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627073968768:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969280.790586:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627073968768:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 111us (8227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969280.790595:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:2.0:1783969280.790636:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:2.0:1783969280.790643:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073969024:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969280.790674:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073969024:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 31us (8231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969280.790681:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00080000:0.0:1783969280.791014:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969280.797327:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969280.797417:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073968896 00000100:00100000:3.0:1783969280.797430:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073968896 00000100:00100000:2.0:1783969280.797918:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073969152 00000100:00100000:2.0:1783969280.797924:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073969152 00000100:00100000:2.0:1783969280.797979:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:2.0:1783969280.797991:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073969152:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969280.798095:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073969152:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 106us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969280.798114:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:2.0:1783969280.798631:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073968640 00000100:00100000:2.0:1783969280.798638:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073968640 00000100:00100000:2.0:1783969280.798682:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 317 00000100:00100000:2.0:1783969280.798689:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2394:x1870627073968640:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969280.798732:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2394:x1870627073968640:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 44us (13923us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969280.798739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 317 00000100:00100000:3.0:1783969280.801821:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00100000:3.0:1783969280.801843:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073968896:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969280.801956:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073968896:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 123us (17072us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969280.801965:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00080000:3.0:1783969280.802003:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783969280.819125:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969281.840645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783969282.791610:0:13203:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd14de3b0 20000000:00000080:1.0:1783969282.791625:0:13203:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93eabbf63000 uarg=0000000000000000 20000000:01000000:1.0:1783969282.791672:0:13203:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783969282.791677:0:13203:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783969282.791681:0:13203:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1783969282.793974:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783969282.794304:0:13203:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783969282.799411:0:13203:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783969282.799444:0:13203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.799467:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303721 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.799476:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b7c expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.799482:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b8a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.799488:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9b98 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.799495:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9ba6 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.799502:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303760 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.799529:0:13203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.799574:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303760 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.799590:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303760 expref: 12 pid: 6515 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969282.799605:0:13203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099218560:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969282.805270:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9ba6 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.805290:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9ba6 expref: 23 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.805306:0:13203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099218688:0@lo:104: 00000100:00100000:0.0:1783969282.805369:0:13203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969282.805439:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9b98 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.805448:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9b98 expref: 23 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.805456:0:13203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099218816:0@lo:104: 00000100:00100000:0.0:1783969282.805477:0:13203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969282.805528:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9b8a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.805537:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9b8a expref: 23 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.805546:0:13203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099218944:0@lo:104: 00000100:00100000:0.0:1783969282.805566:0:13203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969282.805587:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9b7c expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.805595:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9b7c expref: 23 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.805603:0:13203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099219072:0@lo:104: 00000100:00100000:0.0:1783969282.805621:0:13203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969282.805640:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303721 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.805649:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303721 expref: 12 pid: 6516 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.805658:0:13203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099219200:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969282.805695:0:13203:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8562d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969282.805855:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099218688 00000100:00100000:3.0:1783969282.805862:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099218688 00000100:00100000:3.0:1783969282.805904:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099218816 00000100:00100000:3.0:1783969282.805907:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099218816 00000100:00100000:3.0:1783969282.805918:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099218944 00000100:00100000:3.0:1783969282.805920:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099218944 00000100:00100000:3.0:1783969282.805928:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099219072 00000100:00100000:3.0:1783969282.805930:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099219072 00000100:00100000:3.0:1783969282.805955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783969282.805964:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:13203:x1870627099218688:12345-0@lo:104: 00010000:00010000:3.0:1783969282.805977:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806043:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783969282.806050:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+6:13203:x1870627099218688:12345-0@lo:104: Request processed in 87us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.806056:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783969282.806075:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783969282.806081:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:13203:x1870627099218816:12345-0@lo:104: 00010000:00010000:3.0:1783969282.806088:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806248:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783969282.806254:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:13203:x1870627099218816:12345-0@lo:104: Request processed in 174us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.806260:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783969282.806272:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969282.806278:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:13203:x1870627099218944:12345-0@lo:104: 00010000:00010000:3.0:1783969282.806287:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806316:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783969282.806320:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:13203:x1870627099218944:12345-0@lo:104: Request processed in 43us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.806326:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969282.806336:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969282.806347:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:13203:x1870627099219072:12345-0@lo:104: 00010000:00010000:3.0:1783969282.806354:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806401:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783969282.806406:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:13203:x1870627099219072:12345-0@lo:104: Request processed in 60us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.806411:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1783969282.806426:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783969282.806432:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806439:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796e00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969282.806443:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806451:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969282.806458:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969282.806464:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969282.806556:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806563:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969282.806583:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806601:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eab7796e00/0xea31253a47cb9ba6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9bad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806614:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783969282.806617:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806621:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797800 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969282.806624:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806631:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969282.806637:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969282.806642:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969282.806655:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806660:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969282.806665:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806671:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eab7797800/0xea31253a47cb9b98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9b9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806678:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969282.806685:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806691:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf000 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969282.806694:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806701:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969282.806707:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969282.806712:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969282.806722:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806727:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969282.806741:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806748:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf000/0xea31253a47cb9b8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9b91 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806758:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969282.806761:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806766:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf200 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969282.806768:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806783:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969282.806789:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969282.806794:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969282.806806:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806811:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969282.806816:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806822:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cb9b7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9b83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.806835:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969282.806837:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969282.806838:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969282.806846:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969282.806856:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099219328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969282.806889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.806917:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969282.806922:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099219456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969282.806939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.806961:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099219584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969282.806979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.807017:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969282.807023:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099219712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969282.807043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.807067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099219328 00000100:00100000:3.0:1783969282.807070:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099219328 00010000:00010000:3.0:1783969282.807086:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9ba6 expref: 24 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969282.807802:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099219456 00000100:00100000:1.0:1783969282.807809:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099219456 00010000:00010000:1.0:1783969282.807831:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9b98 expref: 25 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969282.807849:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099219584 00000100:00100000:1.0:1783969282.807852:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099219584 00010000:00010000:1.0:1783969282.807861:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9b8a expref: 26 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969282.807871:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099219712 00000100:00100000:1.0:1783969282.807874:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099219712 00010000:00010000:1.0:1783969282.807882:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9b7c expref: 27 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969282.807894:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969282.807900:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+27:3646:x1870627099219456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969282.807912:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969282.807917:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9b98 expref: 27 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.807935:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9b98 expref: 27 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.807953:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969282.807995:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+27:3646:x1870627099219456:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.808003:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969282.808032:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969282.808039:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+26:3648:x1870627099219584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969282.808046:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969282.808051:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9b8a expref: 26 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.808059:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9b8a expref: 26 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.808069:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969282.808227:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+26:3648:x1870627099219584:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.808233:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969282.808246:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783969282.808252:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:3648:x1870627099219712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969282.808260:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969282.808264:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9b7c expref: 25 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.808272:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9b7c expref: 25 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.808289:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969282.808312:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:3648:x1870627099219712:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.808318:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1783969282.808344:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969282.809370:0:13203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099218688:0@lo:104: 00010000:00010000:0.0:1783969282.809401:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796c00/0xea31253a47cb9b9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9b98 expref: 24 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.809416:0:13203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099218816:0@lo:104: 00010000:00010000:0.0:1783969282.809425:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cde400/0xea31253a47cb9b91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9b8a expref: 23 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.809443:0:13203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099218944:0@lo:104: 00010000:00010000:0.0:1783969282.809456:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797a00/0xea31253a47cb9b83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9b7c expref: 22 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.809462:0:13203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099219072:0@lo:104: 00000100:00100000:3.0:1783969282.809611:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783969282.809621:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3646:x1870627099219328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969282.809635:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969282.809641:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9ba6 expref: 21 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.809650:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9ba6 expref: 21 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.809663:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9bad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9ba6 expref: 21 pid: 6515 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.809672:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969282.809710:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3646:x1870627099219328:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (2820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.809717:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783969282.809756:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099219712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969282.809765:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099219584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969282.809798:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099219456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969282.809807:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099219328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969282.822121:0:13203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099218560:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969282.822147:0:13203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1870627099219200:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969282.822186:0:13203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969282.827201:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969282.827291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969282.827359:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073969280 00000100:00100000:0.0:1783969282.827368:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073969280 00010000:00010000:0.0:1783969282.827443:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303760 expref: 13 pid: 6515 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.827476:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073969408 00000100:00100000:0.0:1783969282.827480:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073969408 00010000:00010000:0.0:1783969282.827510:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303721 expref: 14 pid: 6516 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969282.827530:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1783969282.827539:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+14:2392:x1870627073969280:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969282.827555:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969282.827561:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303760 expref: 14 pid: 6515 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827573:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303760 expref: 14 pid: 6515 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827608:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cde600/0xea31253a47cb9bc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303760 expref: 14 pid: 6515 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827625:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969282.827674:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073969280:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 136us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969282.827682:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1783969282.827699:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1783969282.827705:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2118050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:2391:x1870627073969408:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969282.827712:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969282.827716:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303721 expref: 12 pid: 6516 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827724:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303721 expref: 12 pid: 6516 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827734:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796600/0xea31253a47cb9b75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303721 expref: 12 pid: 6516 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827746:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827755:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827770:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827787:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827794:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827802:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827808:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600e00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969282.827812:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827821:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827835:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827844:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969282.827866:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2118050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:2391:x1870627073969408:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 161us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969282.827872:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00010000:00010000:0.0:1783969282.827921:0:13203:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827928:0:13203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.827933:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b600e00/0xea31253a47cb9be5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.875296:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969282.930821:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969282.930847:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099219840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969282.930917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969282.930978:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099219840 00000100:00100000:1.0:1783969282.930985:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099219840 00000100:00100000:1.0:1783969282.931039:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783969282.931047:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099219840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969282.931079:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783969282.931120:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099219840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.931127:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783969282.931168:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099219840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969283.440755:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099219968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969283.440845:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969283.441247:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099219968 00000100:00100000:2.0:1783969283.441257:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099219968 00000100:00100000:2.0:1783969283.441313:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783969283.441322:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099219968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969283.441357:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969283.441455:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099219968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.441463:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783969283.441667:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099219968:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783969283.889789:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969283.952841:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099220224:0@lo:400:kworker.0 00000100:00100000:1.0:1783969283.952936:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969283.953032:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099220736:0@lo:400:kworker.0 00000100:00100000:1.0:1783969283.953069:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969283.953101:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099221248:0@lo:400:kworker.0 00000100:00100000:1.0:1783969283.953150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969283.953350:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099220096:0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.953430:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969283.953459:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099220608:0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.953504:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969283.953522:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099221120:0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.953550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969283.953567:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099221632:0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.953590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969283.953654:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099220352:0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.953681:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969283.953698:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099220864:0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.953729:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099220480:0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.953775:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099220096 00000100:00100000:3.0:1783969283.953783:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099220096 00000100:00100000:3.0:1783969283.953841:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1783969283.953851:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3648:x1870627099220096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.953914:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3648:x1870627099220096:12345-0@lo:400:kworker.0 Request processed in 64us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969283.953922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1783969283.953972:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099220608 00000100:00100000:3.0:1783969283.953976:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099220608 00000100:00100000:3.0:1783969283.954006:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099220352 00000100:00100000:3.0:1783969283.954008:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099220352 00000100:00100000:3.0:1783969283.954024:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783969283.954031:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099220608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.954067:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099220608:12345-0@lo:400:kworker.0 Request processed in 36us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969283.954073:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783969283.954085:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783969283.954091:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099220352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.954120:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099220352:12345-0@lo:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969283.954125:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783969283.954669:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099220096:0@lo:400:kworker.0 00000100:00100000:3.0:1783969283.954693:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099220608:0@lo:400:kworker.0 00000100:00100000:1.0:1783969283.954953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969283.954980:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099221376:0@lo:400:kworker.0 00000100:00100000:1.0:1783969283.955045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969283.955279:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099220224 00000100:00100000:2.0:1783969283.955286:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099220224 00000100:00100000:2.0:1783969283.955323:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099220736 00000100:00100000:2.0:1783969283.955326:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099220736 00000100:00100000:2.0:1783969283.955354:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099221248 00000100:00100000:2.0:1783969283.955357:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099221248 00000100:00100000:2.0:1783969283.955372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099220864 00000100:00100000:2.0:1783969283.955374:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099220864 00000100:00100000:2.0:1783969283.955405:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099221376 00000100:00100000:2.0:1783969283.955408:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099221376 00000100:00100000:2.0:1783969283.955424:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783969283.955432:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099220224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.955494:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099220224:12345-0@lo:400:kworker.0 Request processed in 62us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.955500:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783969283.955517:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1783969283.955523:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099220736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.955554:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099220736:12345-0@lo:400:kworker.0 Request processed in 31us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.955560:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1783969283.955572:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783969283.955577:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099221248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.955605:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099221248:12345-0@lo:400:kworker.0 Request processed in 28us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.955610:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783969283.955635:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783969283.955641:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099220864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.955670:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099220864:12345-0@lo:400:kworker.0 Request processed in 30us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.955676:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783969283.955686:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783969283.955692:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099221376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.955714:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099221376:12345-0@lo:400:kworker.0 Request processed in 23us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.955720:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783969283.955742:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099221120 00000100:00100000:2.0:1783969283.955745:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099221120 00000100:00100000:2.0:1783969283.955771:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099221632 00000100:00100000:2.0:1783969283.955774:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099221632 00000100:00100000:2.0:1783969283.955794:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783969283.955800:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099221120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.955830:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099221120:12345-0@lo:400:kworker.0 Request processed in 30us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.955836:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783969283.955848:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783969283.955854:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099221632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.955881:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099221632:12345-0@lo:400:kworker.0 Request processed in 29us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.955887:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1783969283.955916:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969283.955920:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969283.955923:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969283.955932:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783969283.955977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e1500 x1870627099221120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969283.956003:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099221120:0@lo:400:kworker.0 00010000:00080000:2.0:1783969283.956017:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e3b80 x1870627099221632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969283.956025:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099221632:0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956044:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969283.956050:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099221760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969283.956094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969283.956127:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099221760 00000100:00100000:2.0:1783969283.956130:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099221760 00000100:00100000:2.0:1783969283.956157:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783969283.956164:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099221760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969283.956190:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969283.956227:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099221760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.956234:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1783969283.956263:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e4000 x1870627099221760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969283.956278:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099221760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969283.956308:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099220224:0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956322:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099220736:0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956333:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099221248:0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969283.956467:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099220992:0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969283.956512:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099221504:0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969283.956559:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099220992 00000100:00100000:2.0:1783969283.956562:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099220992 00000100:00100000:2.0:1783969283.956588:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099221504 00000100:00100000:2.0:1783969283.956591:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099221504 00000100:00100000:2.0:1783969283.956609:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783969283.956615:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099220992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956649:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099220992:12345-0@lo:400:kworker.0 Request processed in 34us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.956656:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783969283.956667:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783969283.956673:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099221504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956701:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099221504:12345-0@lo:400:kworker.0 Request processed in 28us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.956707:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1783969283.956725:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969283.956727:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783969283.956747:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e0380 x1870627099220992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969283.956755:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099220992:0@lo:400:kworker.0 00010000:00080000:2.0:1783969283.956764:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e3100 x1870627099221504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969283.956782:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099221504:0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956798:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099220480 00000100:00100000:2.0:1783969283.956801:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099220480 00000100:00100000:2.0:1783969283.956821:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1783969283.956826:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099220480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.956861:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099220480:12345-0@lo:400:kworker.0 Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969283.956867:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1783969283.956890:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099220480:0@lo:400:kworker.0 00000100:00100000:1.0:1783969283.957459:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099220352:0@lo:400:kworker.0 00010000:00080000:1.0:1783969283.958650:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf744700 x1870627099220864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969283.958668:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099220864:0@lo:400:kworker.0 00010000:00080000:1.0:1783969283.958688:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e0e00 x1870627099221376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969283.958696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099221376:0@lo:400:kworker.0 00000100:00100000:2.0:1783969283.962997:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969283.963039:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099221888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969283.964281:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969283.978535:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099221888 00000100:00100000:1.0:1783969283.978559:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099221888 00000100:00100000:1.0:1783969283.978636:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783969283.978649:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099221888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969283.978686:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969283.978810:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099221888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (14534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969283.978819:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1783969283.979364:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab9176a00 x1870627099221888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969283.979421:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099221888:0@lo:13:osp-pre-1-1.0 10000000:01000000:1.0:1783969284.016495:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969284.016506:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e98212a000 from 7 10000000:01000000:1.0:1783969284.016514:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969284.016580:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969284.016594:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969284.016627:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969284.016664:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9177b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969284.016757:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969284.016836:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8562da80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969284.017090:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099222016 00000100:00100000:3.0:1783969284.017101:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099222016 00000100:00100000:3.0:1783969284.017169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1783969284.017181:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099222016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969284.017198:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969284.017215:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9bec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.017242:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9bec expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.017266:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9bec expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.017276:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796000, rc 0) 00000100:00100000:3.0:1783969284.017327:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099222016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969284.017334:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1783969284.017671:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9177b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969284.017690:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969284.017700:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969284.017780:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9177b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969284.017813:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969284.017848:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8562da80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969284.024328:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099222144 00000100:00100000:3.0:1783969284.024351:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099222144 00000100:00100000:3.0:1783969284.024489:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1783969284.024502:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099222144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969284.024775:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099222144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (6959us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969284.024783:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1783969284.025004:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9177b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.025088:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.025168:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969284.025209:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9138a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969284.025421:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099222272 00000100:00100000:3.0:1783969284.025427:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099222272 00000100:00100000:3.0:1783969284.025467:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1783969284.025483:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099222272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969284.025588:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099222272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969284.025595:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1783969284.027536:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783969284.030363:0:13217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783969284.036252:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783969284.036312:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969284.036329:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969284.036346:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969284.036360:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783969284.036364:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab70d7000 from 7 10000000:01000000:2.0:1783969284.036367:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969284.036487:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969284.036496:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969284.036533:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969284.036570:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969284.036671:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969284.036721:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea89d5b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969284.037587:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099222400 00000100:00100000:3.0:1783969284.037600:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099222400 00000100:00100000:3.0:1783969284.037671:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783969284.037683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099222400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969284.037701:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969284.037731:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9bfa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.037765:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9bfa expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.037778:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9bfa expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.037789:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797e00, rc 0) 00000100:00100000:3.0:1783969284.037863:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099222400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969284.037871:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1783969284.041674:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969284.041716:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969284.041731:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969284.041858:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969284.041937:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969284.042030:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea89d5b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969284.042437:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099222528 00000100:00100000:3.0:1783969284.042446:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099222528 00000100:00100000:3.0:1783969284.042513:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783969284.042526:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099222528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969284.042700:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099222528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969284.042709:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1783969284.043543:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969284.043607:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969284.043696:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969284.043739:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea89d5b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969284.045006:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099222656 00000100:00100000:0.0:1783969284.045021:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099222656 00000100:00100000:0.0:1783969284.045080:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1783969284.045092:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099222656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.045305:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099222656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969284.045313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783969284.045437:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969284.046323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969284.046426:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073969536 00000100:00100000:3.0:1783969284.046434:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073969536 00000100:00100000:3.0:1783969284.046477:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 325 00000100:00100000:3.0:1783969284.046487:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:6166:x1870627073969536:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969284.046504:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969284.046528:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303791 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.046581:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303791 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.046595:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303791 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.046607:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797800, rc 0) 00000100:00100000:3.0:1783969284.046667:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073969536:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 180us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969284.046674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 325 00000040:00080000:2.0:1783969284.050374:0:13218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783969284.051473:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783969284.051509:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969284.051524:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.051539:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969284.051577:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783969284.051580:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab929d800 from 7 10000000:01000000:0.0:1783969284.051583:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969284.051634:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.051643:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.051656:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969284.051690:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.051788:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969284.051844:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969284.053830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099222784 00000100:00100000:2.0:1783969284.053849:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099222784 00000100:00100000:2.0:1783969284.053930:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1783969284.053949:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099222784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969284.053970:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969284.054002:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9c0f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969284.054038:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9c0f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969284.054049:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9c0f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969284.054059:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad8000, rc 0) 00000100:00100000:2.0:1783969284.054141:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099222784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969284.054158:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783969284.054195:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969284.054219:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.054231:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969284.054334:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.054373:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969284.054428:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969284.054443:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099222912 00000100:00100000:0.0:1783969284.054447:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099222912 00000100:00100000:0.0:1783969284.054482:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783969284.054489:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099222912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.054616:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099222912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969284.054623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783969284.054656:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099222912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.054685:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099223040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.054727:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969284.054741:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969284.054752:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099223040 00000100:00100000:0.0:1783969284.054755:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099223040 00000100:00100000:0.0:1783969284.054776:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1783969284.054781:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099223040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.054862:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099223040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969284.054869:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1783969284.054908:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099223040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783969284.055692:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783969284.055766:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783969284.055782:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969284.055792:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.055803:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969284.055828:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783969284.055831:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ea912c9800 from 7 10000000:01000000:0.0:1783969284.055835:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969284.055865:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.055873:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.055883:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969284.055902:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099223168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.055943:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969284.055972:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969284.055999:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099223168 00000100:00100000:0.0:1783969284.056004:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099223168 00000100:00100000:0.0:1783969284.056034:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1783969284.056042:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099223168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969284.056053:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969284.056067:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9c1d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.056088:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9c1d expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.056100:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9c1d expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.056119:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf800, rc 0) 00000100:00100000:0.0:1783969284.056151:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099223168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969284.056159:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1783969284.056206:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099223168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969284.056221:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969284.056230:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969284.056277:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099223296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.056302:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969284.056315:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969284.056328:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099223296 00000100:00100000:0.0:1783969284.056332:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099223296 00000100:00100000:0.0:1783969284.056354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1783969284.056360:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099223296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.056472:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099223296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969284.056479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1783969284.056510:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099223296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.056539:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099223424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.056578:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969284.056603:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969284.056615:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099223424 00000100:00100000:0.0:1783969284.056619:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099223424 00000100:00100000:0.0:1783969284.056640:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783969284.056646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099223424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969284.056698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969284.056725:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099223424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969284.056733:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783969284.056760:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073969664 00000100:00100000:0.0:1783969284.056764:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073969664 00000100:00100000:0.0:1783969284.056781:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 332 00000100:00100000:0.0:1783969284.056787:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073969664:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969284.056871:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073969664:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 83us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969284.056878:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 332 00000100:00100000:0.0:1783969284.056909:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099223424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969284.060617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969284.065693:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073969792 00000100:00100000:2.0:1783969284.065713:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073969792 00000100:00100000:2.0:1783969284.065813:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 333 00000100:00100000:2.0:1783969284.065826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073969792:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969284.066566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073969792:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 220us (5440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969284.066579:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 333 00000040:00080000:0.0:1783969284.068349:0:13220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783969284.082938:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783969284.082999:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969284.083015:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969284.083031:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969284.112946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969284.113008:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073969920 00000100:00100000:3.0:1783969284.113021:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073969920 00000100:00100000:3.0:1783969284.113535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 334 00000100:00100000:3.0:1783969284.113551:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073969920:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969284.113576:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969284.113600:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303798 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.113640:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303798 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.113653:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303798 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969284.113811:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796e00, rc 0) 00000100:00100000:3.0:1783969284.113926:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073969920:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 378us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969284.113934:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 334 00000100:00100000:0.0:1783969284.123287:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969284.126580:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073970048 00000100:00100000:1.0:1783969284.126602:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073970048 00000100:00100000:1.0:1783969284.126686:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 335 00000100:00100000:1.0:1783969284.126699:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073970048:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969284.126916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073970048:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 218us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969284.126925:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 335 00000100:00100000:0.0:1783969284.147328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969284.147495:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073970176 00000100:00100000:3.0:1783969284.147507:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073970176 00000100:00100000:3.0:1783969284.147580:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 336 00000100:00100000:3.0:1783969284.147594:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073970176:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969284.147778:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073970176:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 186us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969284.147788:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 336 00000100:00100000:3.0:1783969284.467005:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969284.467039:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099223552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783969284.467133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969284.467766:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099223552 00000100:00100000:1.0:1783969284.467778:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099223552 00000100:00100000:1.0:1783969284.467864:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783969284.467875:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099223552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969284.467913:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969284.467976:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099223552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969284.467996:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1783969284.468760:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab9176d80 x1870627099223552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969284.468786:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099223552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969284.472418:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099223680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969284.472530:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969284.473073:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099223680 00000100:00100000:3.0:1783969284.473083:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099223680 00000100:00100000:3.0:1783969284.473154:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783969284.473165:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099223680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969284.473199:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969284.473269:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099223680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969284.473300:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1783969284.474236:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf744700 x1870627099223680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969284.474267:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099223680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783969284.912900:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969285.940150:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969286.010522:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969286.010558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969286.010588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969286.010608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969286.010629:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969286.010665:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073970560 00000100:00100000:3.0:1783969286.010674:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073970560 00000100:00100000:3.0:1783969286.010730:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073970816 00000100:00100000:3.0:1783969286.010733:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073970816 00000100:00100000:3.0:1783969286.010745:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073970432 00000100:00100000:3.0:1783969286.010747:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073970432 00000100:00100000:3.0:1783969286.010756:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073970688 00000100:00100000:3.0:1783969286.010758:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073970688 00000100:00100000:3.0:1783969286.010773:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:3.0:1783969286.010782:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073970560:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969286.010919:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073970560:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 136us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969286.010927:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:3.0:1783969286.010945:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:3.0:1783969286.010965:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073970816:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969286.010991:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073970816:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 39us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969286.010998:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:3.0:1783969286.011010:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:3.0:1783969286.011016:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073970432:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969286.011053:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627073970432:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969286.011060:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:3.0:1783969286.011073:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00080000:0.0:1783969286.011311:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969286.011317:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969286.012418:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073970304 00000100:00100000:1.0:1783969286.012426:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073970304 00000100:00100000:1.0:1783969286.012474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 337 00000100:00100000:1.0:1783969286.012483:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073970304:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969286.012533:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073970304:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 50us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969286.012540:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 337 00000100:00100000:3.0:1783969286.017598:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073970688:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969286.019200:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073970688:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 8109us (8559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969286.019214:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 211 00010000:00010000:3.0:1783969286.963172:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783969287.498243:0:13402:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783969287.984821:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969288.048987:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099223808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969288.049083:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969288.049303:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099223808 00000100:00100000:3.0:1783969288.049312:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099223808 00000100:00100000:3.0:1783969288.049366:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783969288.049375:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099223808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969288.049436:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783969288.049480:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099223808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969288.049488:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783969288.049634:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099223808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969288.564023:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099223936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969288.564100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969288.564325:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099223936 00000100:00100000:1.0:1783969288.564333:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099223936 00000100:00100000:1.0:1783969288.564415:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783969288.564425:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099223936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969288.564458:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969288.564512:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099223936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969288.564519:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783969288.564867:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099223936:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783969289.009408:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969289.074701:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099224064:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.074777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.074827:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099224576:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.074854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.074874:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099225088:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.074897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.074929:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099225600:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.074952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.074977:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783969289.074984:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099224448:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.075427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.075447:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab734c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099224960:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.075470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.075488:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099225472:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.075509:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.075537:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099224192:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.075560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.079272:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099224704:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079354:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.079378:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099225216:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079424:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.079448:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783969289.079455:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099224320:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.079495:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099224832:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.079526:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099225344:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969289.079586:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099224064 00000100:00100000:0.0:1783969289.079593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099224064 00000100:00100000:0.0:1783969289.079636:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1783969289.079644:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099224064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079692:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099224064:12345-0@lo:400:kworker.0 Request processed in 48us (4914us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969289.079700:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1783969289.079735:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099225088 00000100:00100000:0.0:1783969289.079739:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099225088 00000100:00100000:0.0:1783969289.079762:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099225600 00000100:00100000:0.0:1783969289.079765:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099225600 00000100:00100000:0.0:1783969289.079776:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099224960 00000100:00100000:0.0:1783969289.079778:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099224960 00000100:00100000:0.0:1783969289.079790:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099225472 00000100:00100000:0.0:1783969289.079793:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099225472 00000100:00100000:0.0:1783969289.079804:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783969289.079809:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099225088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079839:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099225088:12345-0@lo:400:kworker.0 Request processed in 30us (4941us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969289.079854:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783969289.079867:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783969289.079873:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099225600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079899:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099225600:12345-0@lo:400:kworker.0 Request processed in 27us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969289.079917:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783969289.079927:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783969289.079932:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099224960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079955:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099224960:12345-0@lo:400:kworker.0 Request processed in 24us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969289.079960:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783969289.079969:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783969289.079974:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099225472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.079995:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099225472:12345-0@lo:400:kworker.0 Request processed in 21us (4486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969289.080000:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783969289.080376:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099225728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969289.080426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969289.080460:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099225728 00000100:00100000:1.0:1783969289.080463:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099225728 00000100:00100000:1.0:1783969289.080497:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783969289.080502:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099225728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969289.080523:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969289.080553:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099225728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.080559:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1783969289.080587:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab9174700 x1870627099225728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969289.080604:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099225728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969289.104968:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099224448 00000100:00100000:1.0:1783969289.104983:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099224448 00000100:00100000:1.0:1783969289.105046:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099224192 00000100:00100000:1.0:1783969289.105049:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099224192 00000100:00100000:1.0:1783969289.105059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099224704 00000100:00100000:1.0:1783969289.105061:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099224704 00000100:00100000:1.0:1783969289.105075:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099225216 00000100:00100000:1.0:1783969289.105077:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099225216 00000100:00100000:1.0:1783969289.105088:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099224832 00000100:00100000:1.0:1783969289.105090:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099224832 00000100:00100000:1.0:1783969289.105100:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099225344 00000100:00100000:1.0:1783969289.105113:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099225344 00000100:00100000:1.0:1783969289.105132:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1783969289.105142:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099224448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.105230:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099224448:12345-0@lo:400:kworker.0 Request processed in 91us (29805us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.105237:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1783969289.105251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783969289.105256:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099224192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.105312:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099224192:12345-0@lo:400:kworker.0 Request processed in 55us (29750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.105318:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783969289.105328:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783969289.105334:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099224704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.105355:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099224704:12345-0@lo:400:kworker.0 Request processed in 22us (26002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.105361:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783969289.105368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783969289.105373:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099225216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.105422:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099225216:12345-0@lo:400:kworker.0 Request processed in 49us (25998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.105427:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783969289.105436:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783969289.105441:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099224832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.105461:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099224832:12345-0@lo:400:kworker.0 Request processed in 20us (25948us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.105466:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783969289.105474:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1783969289.105479:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099225344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.105500:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099225344:12345-0@lo:400:kworker.0 Request processed in 21us (25958us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.105504:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1783969289.105548:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099224576 00000100:00100000:1.0:1783969289.105551:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099224576 00000100:00100000:1.0:1783969289.105572:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099224320 00000100:00100000:1.0:1783969289.105574:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099224320 00000100:00100000:1.0:1783969289.105585:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783969289.105590:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099224576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.105618:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099224576:12345-0@lo:400:kworker.0 Request processed in 28us (30764us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.105624:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783969289.105632:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783969289.105637:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099224320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.105659:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099224320:12345-0@lo:400:kworker.0 Request processed in 22us (26181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.105664:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783969289.105685:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099225856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969289.105720:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969289.105756:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099225856 00000100:00100000:1.0:1783969289.105759:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099225856 00000100:00100000:1.0:1783969289.105779:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783969289.105784:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099225856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969289.105798:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969289.105828:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099225856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969289.105835:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1783969289.105867:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e5180 x1870627099225856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969289.105885:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099225856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969289.105932:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099224320:0@lo:400:kworker.0 00010000:00080000:1.0:1783969289.105952:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8896bb80 x1870627099224832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969289.105961:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099224832:0@lo:400:kworker.0 00010000:00080000:1.0:1783969289.105972:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7210e00 x1870627099225344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969289.105980:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099225344:0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.105991:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099224192:0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.106000:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099224704:0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.106010:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099225216:0@lo:400:kworker.0 00000100:00080000:0.0:1783969289.110948:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969289.110959:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969289.110962:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969289.110965:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969289.119471:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099224448:0@lo:400:kworker.0 00010000:00080000:0.0:1783969289.119499:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab734c380 x1870627099224960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969289.119511:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab734c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099224960:0@lo:400:kworker.0 00010000:00080000:0.0:1783969289.119528:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7213100 x1870627099225472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969289.119557:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099225472:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.119588:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099224064:0@lo:400:kworker.0 00000100:00100000:0.0:1783969289.119602:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099224576:0@lo:400:kworker.0 00010000:00080000:0.0:1783969289.119616:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981acb480 x1870627099225088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969289.119625:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099225088:0@lo:400:kworker.0 00010000:00080000:0.0:1783969289.119638:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7213b80 x1870627099225600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969289.119647:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099225600:0@lo:400:kworker.0 00000100:00100000:1.0:1783969289.586295:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099225984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969289.586424:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969289.586497:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969289.586503:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099226112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969289.586528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969289.586892:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099225984 00000100:00100000:3.0:1783969289.586912:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099225984 00000100:00100000:3.0:1783969289.586976:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099226112 00000100:00100000:3.0:1783969289.586980:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099226112 00000100:00100000:3.0:1783969289.587125:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783969289.587136:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099225984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969289.587175:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969289.587235:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099225984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969289.587263:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783969289.587284:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783969289.587290:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099226112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969289.587301:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969289.587327:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099226112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969289.587333:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1783969289.587396:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a44a80 x1870627099226112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969289.587417:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099226112:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783969289.587430:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e5180 x1870627099225984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969289.587441:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099225984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783969290.033800:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969291.024194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969291.024246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969291.024282:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969291.024313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969291.024342:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969291.024375:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073971200 00000100:00100000:0.0:1783969291.024434:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073971200 00000100:00100000:0.0:1783969291.024505:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073971456 00000100:00100000:0.0:1783969291.024509:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073971456 00000100:00100000:0.0:1783969291.024524:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073971072 00000100:00100000:0.0:1783969291.024527:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073971072 00000100:00100000:0.0:1783969291.024538:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073971328 00000100:00100000:0.0:1783969291.024540:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073971328 00000100:00100000:0.0:1783969291.024557:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:0.0:1783969291.024569:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073971200:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969291.024684:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073971200:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 116us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969291.024693:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:0.0:1783969291.024714:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:0.0:1783969291.024721:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073971456:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969291.024749:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073971456:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969291.024756:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:0.0:1783969291.024771:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:0.0:1783969291.024776:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073971072:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969291.024815:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073971072:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 38us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969291.024821:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:0.0:1783969291.024833:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:0.0:1783969291.024839:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073971328:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969291.024895:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073971328:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 55us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969291.024902:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00080000:0.0:1783969291.024928:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969291.024933:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969291.025176:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073970944 00000100:00100000:3.0:1783969291.025182:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073970944 00000100:00100000:3.0:1783969291.025224:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 339 00000100:00100000:3.0:1783969291.025231:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073970944:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969291.025261:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073970944:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969291.025267:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 339 00010000:00010000:3.0:1783969291.056698:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969292.083537:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969293.122278:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969293.179343:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099226240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969293.179444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969293.179563:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099226240 00000100:00100000:3.0:1783969293.179571:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099226240 00000100:00100000:3.0:1783969293.179633:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783969293.179657:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099226240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969293.179703:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783969293.179751:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099226240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969293.179758:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783969293.179956:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099226240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969293.685083:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969293.685111:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099226368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969293.685185:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969293.685864:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099226368 00000100:00100000:3.0:1783969293.685873:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099226368 00000100:00100000:3.0:1783969293.685934:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783969293.685945:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099226368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969293.685983:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783969293.686217:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099226368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 272us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969293.686226:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783969293.686352:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099226368:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783969294.131535:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969294.196265:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099226624:0@lo:400:kworker.0 00000100:00100000:1.0:1783969294.196353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969294.196437:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099227136:0@lo:400:kworker.0 00000100:00100000:1.0:1783969294.196461:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969294.196486:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099227648:0@lo:400:kworker.0 00000100:00100000:1.0:1783969294.196526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969294.196554:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1783969294.196568:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099226496:0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.196718:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969294.196728:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099228160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969294.196760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969294.196799:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099228160 00000100:00100000:3.0:1783969294.196806:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099228160 00000100:00100000:3.0:1783969294.196875:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783969294.196884:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099228160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969294.196911:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969294.196954:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099228160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.196961:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1783969294.196982:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783969294.197015:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a46300 x1870627099228160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969294.197046:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099228160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969294.197093:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099226624 00000100:00100000:3.0:1783969294.197096:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099226624 00000100:00100000:3.0:1783969294.197120:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099227136 00000100:00100000:3.0:1783969294.197123:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099227136 00000100:00100000:3.0:1783969294.197145:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099227648 00000100:00100000:3.0:1783969294.197147:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099227648 00000100:00100000:0.0:1783969294.197151:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783969294.197165:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099226624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969294.197202:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099226624:12345-0@lo:400:kworker.0 Request processed in 38us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969294.197262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969294.197285:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099227008:0@lo:400:kworker.0 00000100:00100000:1.0:1783969294.197308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969294.197327:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099227520:0@lo:400:kworker.0 00000100:00100000:1.0:1783969294.197350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969294.197367:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099228032:0@lo:400:kworker.0 00000100:00100000:1.0:1783969294.197401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969294.197426:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099226624:0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.199216:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783969294.199233:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099227136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.199326:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099227136:12345-0@lo:400:kworker.0 Request processed in 99us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.199333:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783969294.199349:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783969294.199355:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099227648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.199400:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099227648:12345-0@lo:400:kworker.0 Request processed in 45us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.199406:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783969294.199435:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099226752:0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.199472:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969294.199500:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099227264:0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.199525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969294.199541:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099227776:0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.200091:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969294.200109:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099228288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969294.200154:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969294.200184:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783969294.200191:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099226880:0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.200215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969294.200227:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099227392:0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.200253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969294.200273:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099227904:0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.200293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969294.200421:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099228288 00000100:00100000:3.0:1783969294.200429:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099228288 00000100:00100000:3.0:1783969294.200472:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783969294.200480:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099228288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783969294.200498:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969294.200535:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099228288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.200541:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783969294.200559:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099227520 00000100:00100000:3.0:1783969294.200563:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099227520 00000100:00100000:3.0:1783969294.200704:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099228032 00000100:00100000:3.0:1783969294.200709:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099228032 00000100:00100000:3.0:1783969294.200723:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099227392 00000100:00100000:3.0:1783969294.200725:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099227392 00000100:00100000:3.0:1783969294.200736:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099227904 00000100:00100000:3.0:1783969294.200738:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099227904 00000100:00100000:3.0:1783969294.200748:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783969294.200753:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099227520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.200787:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099227520:12345-0@lo:400:kworker.0 Request processed in 34us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.200802:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783969294.200815:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783969294.200834:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099228032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.200864:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099228032:12345-0@lo:400:kworker.0 Request processed in 44us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.200870:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783969294.200880:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783969294.200885:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099227392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.200923:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099227392:12345-0@lo:400:kworker.0 Request processed in 37us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.200928:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783969294.200939:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783969294.200944:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099227904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.200967:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099227904:12345-0@lo:400:kworker.0 Request processed in 24us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.200973:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1783969294.201101:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969294.201106:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969294.201108:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783969294.201144:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7210e00 x1870627099227392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969294.201159:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099227392:0@lo:400:kworker.0 00010000:00080000:3.0:1783969294.201168:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea88968000 x1870627099227904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969294.201177:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099227904:0@lo:400:kworker.0 00010000:00080000:3.0:1783969294.201196:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983c88000 x1870627099228288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969294.201211:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099228288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969294.201240:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099227264 00000100:00100000:3.0:1783969294.201243:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099227264 00000100:00100000:3.0:1783969294.201269:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099227776 00000100:00100000:3.0:1783969294.201272:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099227776 00000100:00100000:3.0:1783969294.201281:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099226880 00000100:00100000:3.0:1783969294.201283:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099226880 00000100:00100000:3.0:1783969294.201296:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783969294.201376:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099227264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.201434:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099227264:12345-0@lo:400:kworker.0 Request processed in 132us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.201440:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783969294.201453:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783969294.201458:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099227776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.201486:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099227776:12345-0@lo:400:kworker.0 Request processed in 28us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.201491:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783969294.201501:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783969294.201507:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099226880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.201535:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099226880:12345-0@lo:400:kworker.0 Request processed in 28us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.201541:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1783969294.201555:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969294.201572:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099226880:0@lo:400:kworker.0 00010000:00080000:3.0:1783969294.201709:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7213100 x1870627099227264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969294.201718:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099227264:0@lo:400:kworker.0 00010000:00080000:3.0:1783969294.201727:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea88968380 x1870627099227776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969294.201734:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099227776:0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.201785:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099227008 00000100:00100000:3.0:1783969294.201788:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099227008 00000100:00100000:3.0:1783969294.201806:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099226752 00000100:00100000:3.0:1783969294.201809:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099226752 00000100:00100000:3.0:1783969294.201833:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783969294.201839:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099227008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.201884:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099227008:12345-0@lo:400:kworker.0 Request processed in 45us (4574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.201890:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783969294.201902:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783969294.201908:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099226752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969294.202068:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099226752:12345-0@lo:400:kworker.0 Request processed in 159us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969294.202074:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783969294.202098:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099226752:0@lo:400:kworker.0 00000100:00100000:0.0:1783969294.212092:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783969294.212211:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099226496 00000100:00100000:0.0:1783969294.212221:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099226496 00000100:00100000:0.0:1783969294.212273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1783969294.212283:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099226496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969294.212376:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099226496:12345-0@lo:400:kworker.0 Request processed in 94us (15113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969294.212402:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1783969294.212485:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099226496:0@lo:400:kworker.0 00000100:00100000:0.0:1783969294.214201:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099227008:0@lo:400:kworker.0 00010000:00080000:0.0:1783969294.214221:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8896aa00 x1870627099227520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969294.214234:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099227520:0@lo:400:kworker.0 00010000:00080000:0.0:1783969294.214249:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8896b100 x1870627099228032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969294.214258:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099228032:0@lo:400:kworker.0 00000100:00100000:0.0:1783969294.214272:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099227136:0@lo:400:kworker.0 00000100:00100000:0.0:1783969294.214285:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099227648:0@lo:400:kworker.0 00000100:00100000:2.0:1783969294.707092:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969294.707117:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099228416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969294.707186:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969294.707259:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099228416 00000100:00100000:2.0:1783969294.707266:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099228416 00000100:00100000:2.0:1783969294.707325:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783969294.707335:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099228416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969294.707363:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969294.707432:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099228416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969294.707439:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1783969294.707482:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e3100 x1870627099228416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969294.707519:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099228416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969294.708229:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969294.708242:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099228544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969294.708279:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969294.708423:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099228544 00000100:00100000:0.0:1783969294.708429:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099228544 00000100:00100000:0.0:1783969294.708474:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783969294.708482:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099228544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969294.708497:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969294.708535:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099228544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969294.708541:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1783969294.708571:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983c8b480 x1870627099228544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969294.708586:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099228544:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783969295.154134:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783969295.428278:0:13551:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:01:32 (1783969292) === 00000100:00100000:1.0:1783969295.971818:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969295.972031:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073971584 00000100:00100000:3.0:1783969295.972045:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073971584 00000100:00100000:3.0:1783969295.972290:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00080000:0.0:1783969295.972298:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969295.972310:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073971584:12345-192.168.201.34@tcp:41:mkdir.0 00000004:00000024:3.0:1783969295.972367:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783969295.972530:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627073971584:12345-192.168.201.34@tcp:41:mkdir.0 Request processed in 229us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969295.972539:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1783969295.973284:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969295.973526:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073971712 00000100:00100000:2.0:1783969295.973533:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073971712 00000100:00100000:2.0:1783969295.973578:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1783969295.973588:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:10504:x1870627073971712:12345-192.168.201.34@tcp:700:mkdir.0 00000100:00100000:2.0:1783969295.973659:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:10504:x1870627073971712:12345-192.168.201.34@tcp:700:mkdir.0 Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969295.973674:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1783969295.979576:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969295.979686:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073971968 00000100:00100000:2.0:1783969295.979700:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073971968 00000100:00100000:2.0:1783969295.979955:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1783969295.979969:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:10504:x1870627073971968:12345-192.168.201.34@tcp:36:mkdir.0 00010000:00010000:2.0:1783969295.980248:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969295.980289:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9ad4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630370c expref: 6 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.980318:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253f00) 00010000:00010000:2.0:1783969295.980331:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969295.980529:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.980545:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.980557:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.984039:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.984062:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.984075:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985167:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985181:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985190:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969295.985205:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e24cd53 reply state 0000000023f4ad65 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985216:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985222:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93e98216e200) 00010000:00010000:2.0:1783969295.985225:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969295.985228:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783969295.985233:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783969295.985241:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985247:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985261:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985268:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969295.985273:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985281:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985293:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e98216e700) 00010000:00010000:2.0:1783969295.985295:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969295.985299:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985307:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9c32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969295.985326:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e24cd53 reply state 0000000023f4ad65 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985335:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969295.985342:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93e98216ec00) 00010000:00010000:2.0:1783969295.985344:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969295.985346:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783969295.985483:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:10504:x1870627073971968:12345-192.168.201.34@tcp:36:mkdir.0 Request processed in 5513us (5916us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783969295.985492:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1783969296.015951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.017048:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073972096 00000100:00100000:0.0:1783969296.017076:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073972096 00000100:00100000:0.0:1783969296.017171:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:0.0:1783969296.017184:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:10505:x1870627073972096:12345-192.168.201.34@tcp:101:chmod.0 00010000:00010000:0.0:1783969296.017215:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969296.017253:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9c47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630379f expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.017359:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9c4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.017377:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.017457:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969296.017524:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783969296.017544:0:7749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969296.017590:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.017622:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9c47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630379f expref: 9 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.017645:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630379f expref: 8 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.017654:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea8dcb3100) 00010000:00010000:0.0:1783969296.017657:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969296.017660:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde600, rc 0) 00000100:00100000:0.0:1783969296.017993:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:10505:x1870627073972096:12345-192.168.201.34@tcp:101:chmod.0 Request processed in 810us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969296.018002:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:1.0:1783969296.025746:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969296.025863:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073972352 00000100:00100000:2.0:1783969296.025878:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073972352 00000100:00100000:2.0:1783969296.025965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:2.0:1783969296.025978:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+8:10505:x1870627073972352:12345-192.168.201.34@tcp:36:chmod.0 00010000:00010000:2.0:1783969296.026055:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969296.026102:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9c4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630379f expref: 8 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.026126:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea8dcb3100) 00010000:00010000:2.0:1783969296.026140:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969296.026176:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.026190:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.026200:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969296.032856:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000793c6ed5 reply state 000000008742961d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.032883:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.032894:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e98216e700) 00010000:00010000:2.0:1783969296.032896:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783969296.032900:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783969296.032911:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783969296.034101:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+9:10505:x1870627073972352:12345-192.168.201.34@tcp:36:chmod.0 Request processed in 8117us (8365us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783969296.034129:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:1.0:1783969296.089856:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969296.090089:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073972480 00000100:00100000:2.0:1783969296.090103:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073972480 00000100:00100000:2.0:1783969296.090195:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1783969296.090207:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:10506:x1870627073972480:12345-192.168.201.34@tcp:101:chown.0 00010000:00010000:2.0:1783969296.090238:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969296.090266:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0600/0xea31253a47cb9c5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.090356:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9c63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.090374:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9c63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.090432:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9c63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969296.090492:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783969296.090497:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969296.090539:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9c63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.090567:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0600/0xea31253a47cb9c5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037a6 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.090587:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9c63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037a6 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.090631:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e98216e700) 00010000:00010000:2.0:1783969296.090634:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969296.090639:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a0000, rc 0) 00000100:00100000:2.0:1783969296.090881:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+10:10506:x1870627073972480:12345-192.168.201.34@tcp:101:chown.0 Request processed in 675us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969296.090890:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:1.0:1783969296.107106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969296.107214:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073972608 00000100:00100000:3.0:1783969296.107228:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073972608 00000100:00100000:3.0:1783969296.107312:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1783969296.107325:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+10:10506:x1870627073972608:12345-192.168.201.34@tcp:101:chown.0 00010000:00010000:3.0:1783969296.107362:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969296.107434:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9c6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.107527:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.107545:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.107562:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.107576:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.107585:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.107605:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108184:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9c7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108197:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108204:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969296.108263:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783969296.108268:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969296.108293:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108307:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108314:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108322:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108329:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969296.108334:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108343:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108483:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e98216e700) 00010000:00010000:3.0:1783969296.108495:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969296.108502:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108508:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9c71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108525:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108532:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108538:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108544:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969296.108547:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108553:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108561:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93e98216ec00) 00010000:00010000:3.0:1783969296.108564:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969296.108567:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108573:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9c78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.108869:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9c6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037ad expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.110092:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9c7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037ad expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.110103:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93e98216e200) 00010000:00010000:3.0:1783969296.110107:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969296.110110:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796c00, rc 0) 00000100:00100000:3.0:1783969296.110218:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+11:10506:x1870627073972608:12345-192.168.201.34@tcp:101:chown.0 Request processed in 2894us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969296.110228:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1783969296.120997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.121180:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073972736 00000100:00100000:0.0:1783969296.121193:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073972736 00000100:00100000:0.0:1783969296.121271:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1783969296.121284:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c481ab09-d97e-4adb-b42e-68f98b038d20+11:10506:x1870627073972736:12345-192.168.201.34@tcp:900:chown.0 00000100:00100000:0.0:1783969296.121454:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c481ab09-d97e-4adb-b42e-68f98b038d20+11:10506:x1870627073972736:12345-192.168.201.34@tcp:900:chown.0 Request processed in 172us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969296.121464:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1783969296.132343:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969296.132500:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073972992 00000100:00100000:2.0:1783969296.132513:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073972992 00000100:00100000:2.0:1783969296.132610:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:2.0:1783969296.132623:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+11:10506:x1870627073972992:12345-192.168.201.34@tcp:36:chown.0 00010000:00010000:2.0:1783969296.132697:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969296.132743:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9c7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037ad expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.132768:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93e98216e200) 00010000:00010000:2.0:1783969296.132773:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969296.132815:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.132830:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.132841:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969296.141638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969296.141683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969296.141724:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969296.141754:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969296.141912:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073973248 00000100:00100000:2.0:1783969296.141923:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073973248 00000100:00100000:2.0:1783969296.142002:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073973504 00000100:00100000:2.0:1783969296.142006:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073973504 00000100:00100000:2.0:1783969296.142028:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073973376 00000100:00100000:2.0:1783969296.142031:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073973376 00000100:00100000:2.0:1783969296.142052:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:2.0:1783969296.142064:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073973248:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969296.142139:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073973248:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 79us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969296.142147:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:2.0:1783969296.142165:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:2.0:1783969296.142172:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073973504:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969296.142196:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073973504:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969296.142201:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:2.0:1783969296.142214:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00100000:2.0:1783969296.142220:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073973376:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969296.142243:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073973376:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969296.142248:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00080000:1.0:1783969296.142746:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969296.142758:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969296.142918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073973120 00000100:00100000:3.0:1783969296.142923:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073973120 00000100:00100000:3.0:1783969296.142967:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 341 00000100:00100000:3.0:1783969296.142974:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073973120:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969296.143022:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073973120:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 48us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969296.143028:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 341 00000001:00080000:1.0:1783969296.152456:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1783969296.152604:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152617:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152625:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152632:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad9200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969296.152649:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152657:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152673:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93e98216ec00) 00010000:00010000:3.0:1783969296.152676:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969296.152680:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152687:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9c39 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152707:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152713:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152719:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152724:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a1a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969296.152726:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152732:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152739:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93e98216e200) 00010000:00010000:3.0:1783969296.152741:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969296.152750:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152756:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9c40 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152771:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152777:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152782:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152797:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969296.152801:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152807:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152816:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e98216e700) 00010000:00010000:3.0:1783969296.152818:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783969296.152821:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.152826:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9c55 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969296.153100:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000809f77ee reply state 00000000bbc2cc88 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.153116:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.153124:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93e98216e200) 00010000:00010000:2.0:1783969296.153126:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783969296.153135:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783969296.153148:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1783969296.153240:0:6522:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1783969296.153256:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:10506:x1870627073972992:12345-192.168.201.34@tcp:36:chown.0 Request processed in 20632us (20925us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783969296.153265:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00010000:00010000:0.0:1783969296.154211:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.154223:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.154241:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.154247:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969296.154251:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.154259:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.154270:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93e98216e200) 00010000:00010000:0.0:1783969296.154284:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783969296.154287:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.154293:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9c86 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969296.172778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.173174:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073973632 00000100:00100000:0.0:1783969296.173185:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073973632 00000100:00100000:0.0:1783969296.173245:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:0.0:1783969296.173255:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:10507:x1870627073973632:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:0.0:1783969296.173277:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969296.173297:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9c8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037b4 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969296.176422:0:9027:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3077us 00010000:00010000:0.0:1783969296.176592:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969296.190164:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190188:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190198:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190211:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190217:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190223:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190350:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9ca2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190359:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190427:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969296.190462:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783969296.190466:0:9027:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969296.190497:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190509:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190524:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190531:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190536:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969296.190541:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190548:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190560:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e98216e700) 00010000:00010000:0.0:1783969296.190563:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969296.190568:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190575:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9c94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190597:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190603:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190608:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190613:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969296.190621:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190627:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190635:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ea8dcb3000) 00010000:00010000:0.0:1783969296.190637:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969296.190640:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190646:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf600/0xea31253a47cb9c9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190683:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9c8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037b4 expref: 8 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190696:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037b4 expref: 7 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.190703:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93ea8dcb3b00) 00010000:00010000:0.0:1783969296.190706:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783969296.190708:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf000, rc 0) 00000100:00100000:0.0:1783969296.190772:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+7:10507:x1870627073973632:12345-192.168.201.34@tcp:101:touch.500 Request processed in 17518us (18003us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969296.190780:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:1.0:1783969296.198668:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.198972:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073973888 00000100:00100000:0.0:1783969296.198983:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073973888 00000100:00100000:0.0:1783969296.199049:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:0.0:1783969296.199059:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:10507:x1870627073973888:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:0.0:1783969296.199091:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969296.199111:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9ca9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037bb expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.199228:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.199242:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.199253:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.199318:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.199326:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.199333:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969296.200248:0:7749:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1783969296.200841:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9cbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.200854:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9cbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.200995:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9cbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201049:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201058:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201065:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201073:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969296.201076:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201083:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201095:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93ea8dcb3b00) 00010000:00010000:0.0:1783969296.201098:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969296.201102:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201108:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9cb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969296.201118:0:7749:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc80a1cd reply state 0000000053d2769f transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201129:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201135:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff93ea8dcb3900) 00010000:00010000:0.0:1783969296.201143:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783969296.201147:0:7749:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783969296.201182:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9ca9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037bb expref: 10 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201197:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9cbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037bb expref: 9 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.201204:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93ea8dcb3000) 00010000:00010000:0.0:1783969296.201206:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969296.201208:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea80030c00, rc 0) 00000100:00100000:0.0:1783969296.201574:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+10:10507:x1870627073973888:12345-192.168.201.34@tcp:101:touch.500 Request processed in 2515us (2913us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783969296.201584:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:1.0:1783969296.212087:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.212220:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073974144 00000100:00100000:0.0:1783969296.212229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073974144 00000100:00100000:0.0:1783969296.212300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:0.0:1783969296.212308:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+10:10507:x1870627073974144:12345-192.168.201.34@tcp:36:touch.500 00010000:00010000:0.0:1783969296.212355:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969296.212376:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9cbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037bb expref: 10 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.212446:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93ea8dcb3000) 00010000:00010000:0.0:1783969296.212454:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969296.212514:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.212524:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.212536:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969296.212624:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d11a68ee reply state 0000000060777a0c transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.212634:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.212637:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93ea8dcb3f00) 00010000:00010000:0.0:1783969296.212639:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783969296.212641:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969296.212723:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+11:10507:x1870627073974144:12345-192.168.201.34@tcp:36:touch.500 Request processed in 414us (645us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1783969296.212730:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1783969296.214900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.214939:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073974272 00000100:00100000:0.0:1783969296.214947:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073974272 00000100:00100000:0.0:1783969296.215001:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1783969296.215011:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+11:10507:x1870627073974272:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:0.0:1783969296.215031:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969296.215049:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031200/0xea31253a47cb9cd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037c2 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.215102:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031200/0xea31253a47cb9cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037c2 expref: 12 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.215117:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031200/0xea31253a47cb9cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037c2 expref: 12 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.215155:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93ea8dcb3f00) 00010000:00010000:0.0:1783969296.215158:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969296.215161:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea80031200, rc 0) 00000100:00100000:0.0:1783969296.215216:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+12:10507:x1870627073974272:12345-192.168.201.34@tcp:101:touch.500 Request processed in 207us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969296.215223:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:1.0:1783969296.219219:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969296.219305:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073974400 00000100:00100000:3.0:1783969296.219312:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073974400 00000100:00100000:3.0:1783969296.219355:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1783969296.219567:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1870627073974400:12345-192.168.201.34@tcp:8:touch.500 00010000:00080000:2.0:1783969296.219670:0:8437:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:2.0:1783969296.219697:0:8437:0:(genops.c:1406:class_connect()) connect: client c481ab09-d97e-4adb-b42e-68f98b038d20, cookie 0xea31253a47cb9cda 00002000:00100000:2.0:1783969296.219707:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c481ab09-d97e-4adb-b42e-68f98b038d20/ffff93eabf7bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969296.219720:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783969296.219783:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783969296.219822:0:8437:0:(import.c:65:import_set_state_nolock()) ffff93eabf7bd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969296.220051:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2390:x1870627073974400:12345-192.168.201.34@tcp:8:touch.500 Request processed in 672us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969296.220059:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:1.0:1783969296.224664:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.224785:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073974528 00000100:00100000:0.0:1783969296.224805:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073974528 00000100:00100000:0.0:1783969296.225110:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1783969296.225123:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:0:x1870627073974528:12345-192.168.201.34@tcp:2:touch.500 00000100:00080000:1.0:1783969296.225481:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1783969296.238144:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1783969296.238162:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000100:00100000:0.0:1783969296.242201:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:0:x1870627073974528:12345-192.168.201.34@tcp:2:touch.500 Request processed in 17068us (17534us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783969296.242218:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:2.0:1783969296.249606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.249698:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073974784 00000100:00100000:0.0:1783969296.249709:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073974784 00000100:00100000:0.0:1783969296.249812:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:0.0:1783969296.249824:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+12:10507:x1870627073974784:12345-192.168.201.34@tcp:35:touch.500 00000100:00100000:0.0:1783969296.250245:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+13:10507:x1870627073974784:12345-192.168.201.34@tcp:35:touch.500 Request processed in 422us (648us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783969296.250254:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1783969296.267625:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.268181:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073974912 00000100:00100000:0.0:1783969296.268192:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073974912 00000100:00100000:0.0:1783969296.268297:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:0.0:1783969296.268308:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+13:10508:x1870627073974912:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:0.0:1783969296.268348:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969296.268369:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9ce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037c9 expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.268462:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030600/0xea31253a47cb9ce8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.268478:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030600/0xea31253a47cb9ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.268490:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030600/0xea31253a47cb9ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969296.268534:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783969296.268538:0:7749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969296.268573:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030600/0xea31253a47cb9ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.268601:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9ce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037c9 expref: 15 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.268621:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030600/0xea31253a47cb9ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037c9 expref: 14 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.268630:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93ea8dcb3b00) 00010000:00010000:0.0:1783969296.268633:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969296.268637:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea80030600, rc 0) 00000100:00100000:0.0:1783969296.268712:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+14:10508:x1870627073974912:12345-192.168.201.34@tcp:101:rm.0 Request processed in 406us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969296.268720:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:1.0:1783969296.280639:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.280754:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073975168 00000100:00100000:0.0:1783969296.280765:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073975168 00000100:00100000:0.0:1783969296.280839:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:0.0:1783969296.280850:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+14:10508:x1870627073975168:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:0.0:1783969296.280885:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969296.280907:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031a00/0xea31253a47cb9cef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037d0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969296.280998:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783969296.281098:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031a00/0xea31253a47cb9cef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037d0 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.281113:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e98216e700) 00010000:00010000:0.0:1783969296.281116:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969296.281123:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031a00/0xea31253a47cb9cef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037d0 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.281138:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea80031a00, rc 0) 00000100:00100000:0.0:1783969296.281212:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+15:10508:x1870627073975168:12345-192.168.201.34@tcp:101:rm.0 Request processed in 363us (581us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1783969296.281220:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:2.0:1783969296.301982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969296.302067:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073975296 00000100:00100000:3.0:1783969296.302076:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073975296 00000100:00100000:3.0:1783969296.302131:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:3.0:1783969296.302141:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+15:10508:x1870627073975296:12345-192.168.201.34@tcp:37:rm.0 00000100:00100000:2.0:1783969296.312350:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+15:10508:x1870627073975296:12345-192.168.201.34@tcp:37:rm.0 Request processed in 10197us (10364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969296.312366:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1783969296.319085:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.319188:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073975552 00000100:00100000:0.0:1783969296.319198:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073975552 00000100:00100000:0.0:1783969296.319304:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1783969296.319316:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+15:10508:x1870627073975552:12345-192.168.201.34@tcp:35:rm.0 00000100:00100000:0.0:1783969296.319653:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+16:10508:x1870627073975552:12345-192.168.201.34@tcp:35:rm.0 Request processed in 339us (575us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783969296.326104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1783969296.329427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.329993:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073975808 00000100:00100000:0.0:1783969296.330003:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073975808 00000100:00100000:0.0:1783969296.330063:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:0.0:1783969296.330073:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+16:10508:x1870627073975808:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:0.0:1783969296.330097:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969296.330117:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031a00/0xea31253a47cb9cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037d7 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.330221:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9d04 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.330237:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9d04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.330250:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9d04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969296.330261:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783969296.330362:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031a00/0xea31253a47cb9cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037d7 expref: 19 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.330438:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9d04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037d7 expref: 18 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969296.330448:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93ea8dcb3b00) 00010000:00010000:0.0:1783969296.330450:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783969296.330454:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea80030c00, rc 0) 00000100:00100000:0.0:1783969296.330528:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+18:10508:x1870627073975808:12345-192.168.201.34@tcp:101:rm.0 Request processed in 455us (1149us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783969296.330536:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:3.0:1783969296.335248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969296.335547:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073975936 00000100:00100000:0.0:1783969296.335557:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073975936 00000100:00100000:0.0:1783969296.335614:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:0.0:1783969296.335625:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+18:10508:x1870627073975936:12345-192.168.201.34@tcp:41:rm.0 00000004:00000024:0.0:1783969296.335697:0:7749:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1783969296.335773:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+18:10508:x1870627073975936:12345-192.168.201.34@tcp:41:rm.0 Request processed in 150us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969296.335781:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:0.0:1783969296.341262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969296.341618:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073976064 00000100:00100000:2.0:1783969296.341629:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073976064 00000100:00100000:2.0:1783969296.341812:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:2.0:1783969296.341823:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+18:10508:x1870627073976064:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:2.0:1783969296.341844:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969296.341881:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0600/0xea31253a47cb9d12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.341943:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.341957:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.341968:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.341980:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.341987:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.341992:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342107:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9d27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342116:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342123:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969296.342170:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783969296.342175:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969296.342197:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342209:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342217:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342223:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342230:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342236:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969296.342240:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342247:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342259:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93ea8dcb3b00) 00010000:00010000:2.0:1783969296.342262:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969296.342267:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342273:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9d19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342296:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342302:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342308:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342313:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a1a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969296.342316:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342322:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342330:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff93ea8dcb3900) 00010000:00010000:2.0:1783969296.342333:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969296.342336:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342342:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9d20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342368:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0600/0xea31253a47cb9d12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037de expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342426:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9d27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037de expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.342446:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93ea8dcb3f00) 00010000:00010000:2.0:1783969296.342449:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969296.342452:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a0200, rc 0) 00000100:00100000:2.0:1783969296.343026:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:10508:x1870627073976064:12345-192.168.201.34@tcp:101:rm.0 Request processed in 1202us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969296.343034:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:3.0:1783969296.352168:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969296.352346:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073976320 00000100:00100000:1.0:1783969296.352356:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073976320 00000100:00100000:1.0:1783969296.352533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:1.0:1783969296.352545:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+19:10508:x1870627073976320:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:1.0:1783969296.352866:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783969296.352896:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cb9d27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037de expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.352919:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031200/0xea31253a47cb9cd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037c2 expref: 18 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.352931:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93ea8dcb3f00) 00010000:00010000:1.0:1783969296.352941:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030600/0xea31253a47cb9ce8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037c9 expref: 17 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.352951:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93ea8dcb3b00) 00010000:00010000:1.0:1783969296.352955:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969296.352978:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353007:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353017:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353028:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353036:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353042:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353165:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353173:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353180:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783969296.353565:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1783969296.353577:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358481195466ns, next at 359481193195ns, rc = 0 00010000:00010000:1.0:1783969296.353698:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353708:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353727:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353734:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353741:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353748:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353779:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969296.353810:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353817:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353824:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353829:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969296.353834:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353841:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353850:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93ea8dcb3f00) 00010000:00010000:1.0:1783969296.353853:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783969296.353862:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353869:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601400/0xea31253a47cb9d3c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353883:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353889:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353895:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353900:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969296.353903:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353909:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353915:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93ea8dcb3b00) 00010000:00010000:1.0:1783969296.353918:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969296.353920:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353926:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601a00/0xea31253a47cb9d2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969296.353934:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009755967a reply state 000000004b63c6fe transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353953:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969296.353959:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff93ea8dcb3900) 00010000:00010000:1.0:1783969296.353962:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783969296.353964:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783969296.354168:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969296.354176:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.354182:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969296.354186:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.354193:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.354202:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93ea8dcb3f00) 00010000:00010000:2.0:1783969296.354204:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783969296.354207:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.354212:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601600/0xea31253a47cb9d43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969296.354231:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969296.354233:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969296.354234:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969296.355680:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+18:10508:x1870627073976320:12345-192.168.201.34@tcp:36:rm.0 Request processed in 3117us (3638us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783969296.355692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:3.0:1783969296.366131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969296.366486:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073976576 00000100:00100000:2.0:1783969296.366508:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073976576 00000100:00100000:2.0:1783969296.366925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:2.0:1783969296.366938:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+18:10508:x1870627073976576:12345-192.168.201.34@tcp:35:rm.0 00000100:00100000:2.0:1783969296.367685:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+19:10508:x1870627073976576:12345-192.168.201.34@tcp:35:rm.0 Request processed in 747us (1559us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783969296.367701:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1783969296.374762:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969296.375002:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073976832 00000100:00100000:3.0:1783969296.375016:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073976832 00000100:00100000:3.0:1783969296.375087:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:3.0:1783969296.375099:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+19:10508:x1870627073976832:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:3.0:1783969296.375181:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783969296.375216:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80030c00/0xea31253a47cb9d04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037d7 expref: 19 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375245:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9ca2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037b4 expref: 18 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375257:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93ea8dcb3b00) 00010000:00010000:3.0:1783969296.375285:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9c63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037a6 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375294:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e98216e700) 00010000:00010000:3.0:1783969296.375301:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969296.375500:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375516:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375527:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375539:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375547:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375556:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375648:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375655:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.375660:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969296.377729:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783969296.377762:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377772:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377807:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377815:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969296.377820:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377828:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377846:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93ea911e6500) 00010000:00010000:3.0:1783969296.377849:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783969296.377860:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377868:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796600/0xea31253a47cb9d58 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377904:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377910:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377917:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377922:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969296.377924:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377938:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377946:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea911e6a00) 00010000:00010000:3.0:1783969296.377948:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969296.377951:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377957:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9d4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969296.377969:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042e516b6 reply state 00000000066b798c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377984:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969296.377992:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ea911e6f00) 00010000:00010000:3.0:1783969296.377995:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969296.377999:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969296.378112:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+18:10508:x1870627073976832:12345-192.168.201.34@tcp:36:rm.0 Request processed in 3009us (3360us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783969296.378124:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00010000:00010000:3.0:1783969297.201306:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969298.240721:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969298.293824:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969298.303626:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099228672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969298.303762:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969298.312335:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099228672 00000100:00100000:3.0:1783969298.312355:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099228672 00000100:00100000:2.0:1783969298.318339:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783969298.318364:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099228672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783969298.318451:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783969298.318582:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099228672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 226us (14827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969298.318590:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783969298.318713:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099228672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969298.803701:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969298.803732:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099228800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969298.803835:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969298.806088:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099228800 00000100:00100000:2.0:1783969298.806111:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099228800 00000100:00100000:2.0:1783969298.806193:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783969298.806205:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099228800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969298.806257:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969298.806355:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099228800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969298.806363:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783969298.806515:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099228800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783969299.248507:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783969299.312711:0:9984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361440326048ns, next at 362440322350ns, rc = 0 00000100:00100000:3.0:1783969299.312779:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099228928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969299.313318:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.313631:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099228928 00000100:00100000:3.0:1783969299.313642:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099228928 00000100:00100000:3.0:1783969299.313710:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783969299.313722:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099228928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969299.313779:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969299.313850:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099228928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969299.313858:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1783969299.313884:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783969299.313923:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7417800 x1870627099228928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969299.313946:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099228928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969299.314693:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969299.314711:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099229056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969299.314938:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.315675:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099229056 00000100:00100000:0.0:1783969299.315797:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099229056 00000100:00100000:0.0:1783969299.315860:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783969299.315869:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099229056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969299.315896:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969299.315959:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099229056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.315982:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1783969299.316034:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983c89f80 x1870627099229056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969299.316054:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099229056:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783969299.317901:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969299.319296:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099229184:0@lo:400:kworker.0 00000100:00100000:0.0:1783969299.319398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.319447:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099229184 00000100:00100000:0.0:1783969299.319455:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099229696:0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.319464:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099229184 00000100:00100000:0.0:1783969299.319486:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.319519:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099230208:0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.319533:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1783969299.319558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.319566:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099229184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969299.319599:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783969299.319610:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099229568:0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.319665:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099229184:12345-0@lo:400:kworker.0 Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.319667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.319680:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1783969299.319709:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099230080:0@lo:400:kworker.0 00000100:00100000:0.0:1783969299.319751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.319809:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099229184:0@lo:400:kworker.0 00000100:00100000:0.0:1783969299.319852:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099229696 00000100:00100000:0.0:1783969299.319858:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099229696 00000100:00100000:0.0:1783969299.319894:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783969299.319900:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099229696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.320420:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099230208 00000100:00100000:2.0:1783969299.320430:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099230208 00000100:00100000:2.0:1783969299.320481:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099230080 00000100:00100000:2.0:1783969299.320484:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099230080 00000100:00100000:2.0:1783969299.320511:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783969299.320518:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099230208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.320574:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099230208:12345-0@lo:400:kworker.0 Request processed in 57us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.320581:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783969299.320594:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783969299.320599:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099230080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.320626:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099230080:12345-0@lo:400:kworker.0 Request processed in 27us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.320632:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783969299.320760:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099229312:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.320819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.321020:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099229824:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.321049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.321074:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099230336:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.321099:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.321130:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783969299.321138:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099229440:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.321165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.321176:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099229952:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.321198:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.321230:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099230464:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.321251:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783969299.321280:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969299.321296:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099229568 00000100:00100000:3.0:1783969299.321300:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099229568 00000100:00100000:3.0:1783969299.321330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099229312 00000100:00100000:3.0:1783969299.321332:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099229312 00000100:00100000:3.0:1783969299.321342:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099229824 00000100:00100000:3.0:1783969299.321344:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099229824 00000100:00100000:2.0:1783969299.321437:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099230336 00000100:00100000:2.0:1783969299.321446:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099230336 00000100:00100000:0.0:1783969299.322239:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099229696:12345-0@lo:400:kworker.0 Request processed in 2331us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.322252:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783969299.322288:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099229440 00000100:00100000:0.0:1783969299.322292:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099229440 00000100:00100000:0.0:1783969299.322316:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783969299.322324:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099229440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.322518:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099229952 00000100:00100000:2.0:1783969299.322527:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099229952 00000100:00100000:2.0:1783969299.322543:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099230464 00000100:00100000:2.0:1783969299.322546:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099230464 00000100:00100000:2.0:1783969299.322563:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1783969299.322573:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099229568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.322644:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099229568:12345-0@lo:400:kworker.0 Request processed in 73us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.322664:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1783969299.322682:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783969299.322689:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099229312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969299.322706:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099229440:12345-0@lo:400:kworker.0 Request processed in 380us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.322715:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783969299.322765:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783969299.322775:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099230336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.322820:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099229312:12345-0@lo:400:kworker.0 Request processed in 128us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.322840:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099230336:12345-0@lo:400:kworker.0 Request processed in 66us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.322858:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783969299.322878:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783969299.322885:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099229952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.322906:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783969299.322931:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783969299.322938:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099230464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969299.322979:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099230464:12345-0@lo:400:kworker.0 Request processed in 42us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.322984:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:2.0:1783969299.323588:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969299.323593:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969299.324544:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099229952:12345-0@lo:400:kworker.0 Request processed in 1652us (3337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.324557:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783969299.324673:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099229568:0@lo:400:kworker.0 00010000:00080000:0.0:1783969299.324696:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983713100 x1870627099230080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969299.324711:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099230080:0@lo:400:kworker.0 00000100:00100000:0.0:1783969299.324727:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099229696:0@lo:400:kworker.0 00010000:00080000:0.0:1783969299.324752:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262f480 x1870627099230208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969299.324777:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099230208:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.325126:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783969299.325141:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099229824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.325188:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099229824:12345-0@lo:400:kworker.0 Request processed in 52us (4137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969299.325194:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783969299.325230:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099229440:0@lo:400:kworker.0 00010000:00080000:3.0:1783969299.325243:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e3b80 x1870627099229952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969299.325253:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099229952:0@lo:400:kworker.0 00010000:00080000:3.0:1783969299.325267:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98262f100 x1870627099230464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969299.325275:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099230464:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.325289:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099229312:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.325300:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099229824:0@lo:400:kworker.0 00000100:00100000:3.0:1783969299.325312:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099230336:0@lo:400:kworker.0 00000100:00100000:1.0:1783969299.827785:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099230592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969299.827874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.827941:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969299.827948:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099230720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969299.827977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.828014:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099230592 00000100:00100000:1.0:1783969299.828022:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099230592 00000100:00100000:1.0:1783969299.828064:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099230720 00000100:00100000:1.0:1783969299.828068:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099230720 00000100:00100000:1.0:1783969299.828083:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783969299.828091:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099230592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969299.828122:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969299.828165:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099230592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.828173:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783969299.828189:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783969299.828205:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099230720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969299.828217:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969299.828243:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099230720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.828248:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1783969299.828282:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8e967100 x1870627099230720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969299.828300:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099230720:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1783969299.828311:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319fb80 x1870627099230592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969299.828323:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099230592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783969300.273443:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969301.260467:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969301.260504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969301.260544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969301.260568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969301.260588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969301.260615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969301.260658:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073977216 00000100:00100000:0.0:1783969301.260670:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073977216 00000100:00100000:1.0:1783969301.260826:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073976960 00000100:00100000:1.0:1783969301.260831:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073976960 00000100:00100000:1.0:1783969301.260886:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 343 00000100:00100000:1.0:1783969301.260898:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2393:x1870627073976960:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969301.261002:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2393:x1870627073976960:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 105us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969301.261011:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 343 00000100:00100000:1.0:1783969301.261226:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073977472 00000100:00100000:1.0:1783969301.261231:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073977472 00000100:00100000:1.0:1783969301.261264:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073977088 00000100:00100000:1.0:1783969301.261267:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073977088 00000100:00100000:1.0:1783969301.261281:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073977600 00000100:00100000:1.0:1783969301.261283:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073977600 00000100:00100000:1.0:1783969301.261298:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:1.0:1783969301.261305:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073977472:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969301.261366:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073977472:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 60us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969301.261373:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:1.0:1783969301.261418:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:1.0:1783969301.261425:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+18:2393:x1870627073977088:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969301.261457:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+18:2393:x1870627073977088:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 33us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969301.261463:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:1.0:1783969301.261474:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 239 00000100:00100000:1.0:1783969301.261480:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073977600:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969301.261513:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073977600:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 33us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969301.261519:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 239 00000100:00100000:1.0:1783969301.261539:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073977344 00000100:00100000:1.0:1783969301.261543:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073977344 00000100:00100000:1.0:1783969301.261574:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:1.0:1783969301.261588:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073977344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969301.261616:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073977344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 36us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969301.261622:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00080000:1.0:1783969301.261656:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969301.261662:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969301.261664:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969301.262342:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:0.0:1783969301.262355:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073977216:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969301.262409:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073977216:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 57us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969301.262417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 240 00010000:00010000:1.0:1783969301.299769:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783969301.880715:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1783969301.880757:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1783969301.880768:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1783969301.880828:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880840:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880848:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880855:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80031000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969301.880859:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880880:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880900:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff93ea8dcb3900) 00010000:00010000:0.0:1783969301.880903:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969301.880908:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880915:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031000/0xea31253a47cb9cb7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880937:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880943:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880948:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880954:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80031e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969301.880957:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880963:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880970:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93ea8dcb3f00) 00010000:00010000:0.0:1783969301.880972:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969301.880975:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.880989:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea80031e00/0xea31253a47cb9ccc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881008:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881015:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881020:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881025:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969301.881028:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881034:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881042:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff93ea8dcb3900) 00010000:00010000:0.0:1783969301.881045:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969301.881047:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881053:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b601200/0xea31253a47cb9d35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881067:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881073:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881085:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881090:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969301.881093:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881099:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881108:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ea911e6f00) 00010000:00010000:0.0:1783969301.881111:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969301.881114:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969301.881320:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9d51 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969301.881538:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969301.881557:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099230848:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783969301.881624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969301.881726:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099230848 00000100:00100000:3.0:1783969301.881734:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099230848 00000100:00100000:3.0:1783969301.881798:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969301.881807:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099230848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783969301.881834:0:9974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1783969301.881868:0:9974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a55360f, atime: 0x6a55360f, ctime: 0x6a55360f, blocks: 0x0 00010000:00010000:3.0:1783969301.881875:0:9974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.881890:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1783969301.881894:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969301.881900:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.881916:0:9974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.881924:0:9974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.881931:0:9974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.881948:0:9974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783969301.882090:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1870627099230848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 283us (466us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783969301.882108:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1783969301.882221:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969301.882227:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.882234:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969301.882238:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.882245:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.882257:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.882264:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cb9d5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969301.882278:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969301.882280:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969301.882281:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783969301.882314:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ea8e967100/2, rc 0, transno 4294967301 00000100:00100000:3.0:1783969301.882320:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099230848:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1783969301.882458:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1783969302.288483:0:13700:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1783969302.322355:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969303.346475:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969303.415754:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969303.415793:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099230976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969303.415889:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969303.416120:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099230976 00000100:00100000:0.0:1783969303.416131:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099230976 00000100:00100000:0.0:1783969303.416200:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783969303.416224:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099230976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969303.416272:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783969303.416330:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099230976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969303.416349:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783969303.417104:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099230976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969303.925355:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969303.925412:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099231104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969303.925500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969303.925593:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099231104 00000100:00100000:1.0:1783969303.925602:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099231104 00000100:00100000:1.0:1783969303.925681:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783969303.925692:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099231104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969303.925749:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969303.925805:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099231104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969303.925813:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783969303.933796:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099231104:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1783969303.984225:0:13748:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe52fdae40 20000000:00000080:0.0:1783969303.984249:0:13748:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93eabf7a7000 uarg=0000000000000000 20000000:01000000:0.0:1783969303.984313:0:13748:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783969303.984322:0:13748:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783969303.984329:0:13748:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1783969303.985225:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1783969303.991024:0:13748:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1783969303.994838:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1783969303.994884:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1783969303.994901:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1783969303.994919:0:13748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783969303.995104:0:13748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995147:0:13748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9bec expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995156:0:13748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9bfa expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995166:0:13748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303791 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995174:0:13748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9c0f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995181:0:13748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9c1d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995188:0:13748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303798 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995197:0:13748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995257:0:13748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303798 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995275:0:13748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303798 expref: 12 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969303.995295:0:13748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231232:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969303.995648:0:13748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9c1d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.995674:0:13748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9c1d expref: 23 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969303.995685:0:13748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231360:0@lo:104: 00000100:00100000:2.0:1783969303.996092:0:13748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969303.996203:0:13748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9c0f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.996213:0:13748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9c0f expref: 23 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969303.996223:0:13748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231488:0@lo:104: 00010000:00010000:2.0:1783969303.996256:0:13748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303791 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.996265:0:13748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303791 expref: 12 pid: 6516 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969303.996274:0:13748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231616:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969303.996310:0:13748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9bfa expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.996319:0:13748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9bfa expref: 23 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969303.996328:0:13748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231744:0@lo:104: 00010000:00010000:2.0:1783969303.996353:0:13748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9bec expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.996371:0:13748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9bec expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969303.996405:0:13748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231872:0@lo:104: 00000100:00100000:2.0:1783969303.996428:0:13748:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea990ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969303.996822:0:8453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783969303.997205:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969303.997344:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969303.997472:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969303.997488:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099231360 00000100:00100000:2.0:1783969303.997498:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099231360 00000100:00100000:2.0:1783969303.997698:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099231488 00000100:00100000:2.0:1783969303.997702:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099231488 00000100:00100000:2.0:1783969303.997715:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099231744 00000100:00100000:2.0:1783969303.997718:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099231744 00000100:00100000:2.0:1783969303.997814:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783969303.997835:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab777d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:13748:x1870627099231360:12345-0@lo:104: 00010000:00010000:2.0:1783969303.997855:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.997934:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783969303.998048:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab777d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+5:13748:x1870627099231360:12345-0@lo:104: Request processed in 224us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969303.998055:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783969303.998120:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783969303.998127:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:13748:x1870627099231488:12345-0@lo:104: 00010000:00010000:2.0:1783969303.998136:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.998170:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783969303.998175:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+4:13748:x1870627099231488:12345-0@lo:104: Request processed in 50us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969303.998192:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783969303.998205:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783969303.998210:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:13748:x1870627099231744:12345-0@lo:104: 00010000:00010000:2.0:1783969303.998218:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969303.998254:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783969303.998259:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:13748:x1870627099231744:12345-0@lo:104: Request processed in 49us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969303.998265:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783969303.998320:0:13748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231360:0@lo:104: 00000100:00100000:2.0:1783969303.998330:0:13748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231488:0@lo:104: 00000100:00100000:2.0:1783969303.998337:0:13748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231744:0@lo:104: 00010000:00010000:0.0:1783969303.999325:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783969303.999337:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969303.999348:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdfa00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969303.999353:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969303.999364:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969303.999372:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969303.999399:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969303.999453:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969303.999461:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969303.999493:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969303.999502:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cdfa00/0xea31253a47cb9c1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969303.999537:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969303.999541:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969303.999956:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde400 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969303.999960:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969303.999968:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969303.999975:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.000019:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969304.000032:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.000056:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad9e00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969304.000060:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.000070:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969304.000077:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969304.000082:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969304.000345:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.000352:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969304.000373:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.000395:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad9e00/0xea31253a47cb9bfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.000408:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969304.000410:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969304.000411:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969304.000420:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969304.000440:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099232000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969304.000497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1783969304.001025:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969304.001060:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969304.001067:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969304.001080:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969304.001086:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cde400/0xea31253a47cb9c0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969304.001101:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969304.001102:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969304.001104:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969304.003350:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099232128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969304.003456:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969304.003515:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969304.003522:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099232256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969304.004576:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099231872 00000100:00100000:1.0:1783969304.004591:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099231872 00000100:00100000:1.0:1783969304.004684:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783969304.004696:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:13748:x1870627099231872:12345-0@lo:104: 00010000:00010000:1.0:1783969304.004719:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.004819:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969304.004838:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:13748:x1870627099231872:12345-0@lo:104: Request processed in 144us (7365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969304.004846:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1783969304.004876:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969304.004897:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.004906:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600800 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:1.0:1783969304.004911:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.004921:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969304.004930:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969304.004947:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783969304.004992:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.005000:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969304.005025:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.005033:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b600800/0xea31253a47cb9bec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9bf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.005055:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969304.005057:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969304.005059:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969304.005480:0:13748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231872:0@lo:104: 00000100:00100000:1.0:1783969304.005728:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099232000 00000100:00100000:1.0:1783969304.005735:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099232000 00010000:00010000:1.0:1783969304.005767:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9c1d expref: 24 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969304.005818:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099232128 00000100:00100000:3.0:1783969304.005876:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969304.005923:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099232128 00010000:00010000:1.0:1783969304.005952:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9bfa expref: 25 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.006507:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969304.008276:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099232256 00000100:00100000:2.0:1783969304.008294:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099232256 00010000:00010000:2.0:1783969304.008339:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9c0f expref: 26 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969304.008371:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783969304.008394:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+26:3646:x1870627099232000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969304.008416:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969304.008424:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9c1d expref: 26 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969304.008437:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9c1d expref: 26 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969304.008450:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099232384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969304.008491:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdf800/0xea31253a47cb9c24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9c1d expref: 26 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969304.008514:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969304.010063:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783969304.010090:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:3648:x1870627099232128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969304.010111:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969304.010123:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9bfa expref: 25 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.010138:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9bfa expref: 25 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.010155:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797e00/0xea31253a47cb9c01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9bfa expref: 25 pid: 6516 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.010171:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969304.010245:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099232128:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (6788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969304.010252:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783969304.010288:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783969304.010296:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:3648:x1870627099232256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969304.010306:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969304.010311:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9c0f expref: 23 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.010318:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9c0f expref: 23 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.010342:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad8000/0xea31253a47cb9c16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9c0f expref: 23 pid: 6515 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.010352:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969304.010395:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:3648:x1870627099232256:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (4511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969304.010402:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783969304.010506:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3646:x1870627099232000:12345-0@lo:103:ldlm_bl.0 Request processed in 583us (8464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969304.010515:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783969304.011228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969304.011317:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099232000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969304.011463:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969304.011539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969304.011571:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099232256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969304.011580:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099232128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969304.011604:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099232384 00000100:00100000:3.0:1783969304.011609:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099232384 00010000:00010000:3.0:1783969304.011638:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9bec expref: 21 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969304.011721:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073977856 00000100:00100000:3.0:1783969304.011725:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073977856 00010000:00010000:3.0:1783969304.011738:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303791 expref: 13 pid: 6516 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969304.011748:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073977728 00000100:00100000:3.0:1783969304.011749:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073977728 00010000:00010000:3.0:1783969304.011757:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303798 expref: 14 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969304.011769:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783969304.011789:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3646:x1870627099232384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969304.011801:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969304.011807:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9bec expref: 21 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.011816:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9bec expref: 21 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.011834:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796000/0xea31253a47cb9bf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9bec expref: 21 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.011847:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969304.011884:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3646:x1870627099232384:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969304.011891:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783969304.011907:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1783969304.011912:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+14:2391:x1870627073977856:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969304.011920:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969304.011924:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303791 expref: 14 pid: 6516 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.011933:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303791 expref: 14 pid: 6516 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.011942:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969304.011971:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+14:2391:x1870627073977856:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 59us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969304.011977:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1783969304.011994:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1783969304.011999:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073977728:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969304.012006:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969304.012010:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303798 expref: 13 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012019:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303798 expref: 13 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012030:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012038:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012052:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012059:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012065:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012072:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012079:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0c00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969304.012084:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012102:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012112:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969304.012121:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969304.012139:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073977728:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 139us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969304.012145:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1783969304.012169:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099232384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969304.015275:0:13748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796e00/0xea31253a47cb9c2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303798 expref: 12 pid: 6514 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969304.015306:0:13748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231232:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969304.015323:0:13748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797800/0xea31253a47cb9c08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303791 expref: 11 pid: 6516 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969304.015333:0:13748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13748:1870627099231616:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969304.015409:0:13748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969304.015421:0:13748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969304.015427:0:13748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969304.015433:0:13748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea813a0c00/0xea31253a47cb9d66 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969304.369756:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969304.433247:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969304.433283:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099232512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969304.433417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969304.433641:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099232512 00000100:00100000:3.0:1783969304.433651:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099232512 00000100:00100000:3.0:1783969304.433746:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783969304.433758:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870627099232512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969304.433795:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969304.433856:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870627099232512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969304.433863:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783969304.433919:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099232512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969304.434341:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099232640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969304.434414:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969304.434459:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099232640 00000100:00100000:0.0:1783969304.434463:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099232640 00000100:00100000:0.0:1783969304.434492:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783969304.434499:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099232640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969304.434512:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969304.434543:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099232640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969304.434549:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783969304.434592:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099232640:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783969304.435364:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969304.435530:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099232896:0@lo:400:kworker.0 00000100:00100000:3.0:1783969304.435590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969304.435628:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099233408:0@lo:400:kworker.0 00000100:00100000:3.0:1783969304.435666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969304.435695:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783969304.435716:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099233024:0@lo:400:kworker.0 00000100:00100000:1.0:1783969304.435842:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099233408 00000100:00100000:1.0:1783969304.435849:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099233408 00000100:00100000:1.0:1783969304.435900:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783969304.435909:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099233408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969304.435959:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099233408:12345-0@lo:400:kworker.0 Request processed in 51us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969304.435966:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1783969304.435990:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969304.436075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969304.436113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099233536:0@lo:400:kworker.0 00000100:00100000:3.0:1783969304.436138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783969304.436170:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98362b800 x1870627099233408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969304.436183:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099233408:0@lo:400:kworker.0 00000100:00100000:2.0:1783969304.436290:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099232896 00000100:00100000:2.0:1783969304.436302:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099232896 00000100:00100000:2.0:1783969304.436330:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783969304.436336:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099232896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969304.436377:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099232896:12345-0@lo:400:kworker.0 Request processed in 41us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969304.436421:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783969304.436499:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099232896:0@lo:400:kworker.0 00000100:00100000:3.0:1783969304.436519:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099233536 00000100:00100000:3.0:1783969304.436523:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099233536 00000100:00100000:3.0:1783969304.436564:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783969304.436571:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099233536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969304.436606:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099233536:12345-0@lo:400:kworker.0 Request processed in 35us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969304.436612:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783969304.436855:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099232768:0@lo:400:kworker.0 00000100:00100000:0.0:1783969304.436890:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969304.436911:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099233280:0@lo:400:kworker.0 00000100:00100000:0.0:1783969304.436931:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969304.436946:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099233792:0@lo:400:kworker.0 00000100:00100000:0.0:1783969304.436965:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969304.436983:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783969304.436989:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099233152:0@lo:400:kworker.0 00000100:00100000:0.0:1783969304.437009:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969304.437026:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099233664:0@lo:400:kworker.0 00000100:00100000:0.0:1783969304.437046:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969304.437064:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099233024 00000100:00100000:0.0:1783969304.437068:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099233024 00000100:00100000:0.0:1783969304.437091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099232768 00000100:00100000:0.0:1783969304.437093:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099232768 00000100:00100000:0.0:1783969304.437104:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099233280 00000100:00100000:0.0:1783969304.437114:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099233280 00000100:00100000:0.0:1783969304.437133:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099233792 00000100:00100000:0.0:1783969304.437136:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099233792 00000100:00100000:0.0:1783969304.437147:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099233152 00000100:00100000:0.0:1783969304.437149:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099233152 00000100:00100000:0.0:1783969304.437159:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099233664 00000100:00100000:0.0:1783969304.437161:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099233664 00000100:00100000:0.0:1783969304.437175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783969304.437180:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099233024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969304.437339:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783969304.437348:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099232768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969304.437423:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099233024:12345-0@lo:400:kworker.0 Request processed in 241us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969304.437430:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783969304.437445:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783969304.437450:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099233280:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783969304.437503:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969304.437507:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969304.437509:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783969304.437563:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319c380 x1870627099233536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969304.437575:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099233536:0@lo:400:kworker.0 00000100:00100000:3.0:1783969304.437597:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099233024:0@lo:400:kworker.0 00000100:00100000:3.0:1783969304.437617:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783969304.437624:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099233792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969304.437865:0:7749:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1783969304.437876:0:7749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1783969304.438491:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099232768:12345-0@lo:400:kworker.0 Request processed in 1141us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969304.438501:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783969304.438523:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783969304.438532:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099233152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969304.438574:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099233152:12345-0@lo:400:kworker.0 Request processed in 45us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969304.438580:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783969304.438591:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783969304.438596:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099233664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969304.438619:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099233664:12345-0@lo:400:kworker.0 Request processed in 23us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969304.438624:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1783969304.438941:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099233152:0@lo:400:kworker.0 00000100:00100000:2.0:1783969304.438955:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099233664:0@lo:400:kworker.0 00000100:00100000:2.0:1783969304.438966:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099232768:0@lo:400:kworker.0 00000100:00100000:0.0:1783969304.439156:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099233280:12345-0@lo:400:kworker.0 Request processed in 1703us (2222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969304.439164:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:2.0:1783969304.439290:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983629500 x1870627099233280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969304.439303:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099233280:0@lo:400:kworker.0 00000100:00100000:3.0:1783969304.439901:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099233792:12345-0@lo:400:kworker.0 Request processed in 2273us (2930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969304.439908:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00080000:2.0:1783969304.439978:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf746300 x1870627099233792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969304.439989:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099233792:0@lo:400:kworker.0 00000100:00100000:1.0:1783969304.949932:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099233920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969304.950044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969304.950222:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099233920 00000100:00100000:2.0:1783969304.950233:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099233920 00000100:00100000:2.0:1783969304.950311:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783969304.950322:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099233920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969304.950365:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969304.961169:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099234048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969304.961260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969304.961365:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099233920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11033us (11310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969304.961399:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099234048 00000100:00100000:2.0:1783969304.961399:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783969304.961419:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099234048 00000100:00100000:3.0:1783969304.961478:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783969304.961489:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099234048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969304.961523:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969304.961605:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099234048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969304.961612:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1783969304.962912:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea8896b100 x1870627099234048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969304.962946:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099234048:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1783969304.965340:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf746300 x1870627099233920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969304.965417:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099233920:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1783969305.137463:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783969305.137474:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e98212a000 from 7 10000000:01000000:2.0:1783969305.137480:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969305.137542:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969305.137558:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969305.137573:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969305.137611:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099234176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969305.137712:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969305.137793:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea990ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1783969305.137939:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099234176 00000100:00100000:0.0:1783969305.137949:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099234176 00000100:00100000:0.0:1783969305.138019:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1783969305.138034:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099234176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969305.138053:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969305.138081:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9d6d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.138112:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9d6d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.138132:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9d6d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.138144:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf000, rc 0) 00000100:00100000:0.0:1783969305.138847:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099234176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 811us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969305.138857:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000020:00000080:3.0:1783969305.139869:0:13799:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9853ec80 20000000:00000080:3.0:1783969305.139891:0:13799:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93e983440800 uarg=0000000000000000 20000000:01000000:3.0:1783969305.139951:0:13799:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1783969305.139960:0:13799:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1783969305.139967:0:13799:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000100:00100000:2.0:1783969305.141981:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099234176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969305.142020:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969305.142036:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969305.142162:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099234304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969305.142263:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969305.142322:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea990ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.142431:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099234304 00000100:00100000:1.0:1783969305.142439:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099234304 00000100:00100000:1.0:1783969305.142507:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783969305.142519:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099234304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.142715:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099234304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.142724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1783969305.143010:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099234304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969305.143061:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099234432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969305.143129:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969305.143166:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.143270:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099234432 00000100:00100000:1.0:1783969305.143275:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099234432 00000100:00100000:1.0:1783969305.143315:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1783969305.143323:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099234432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.143449:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099234432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.143464:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783969305.143605:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099234432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783969305.144313:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1783969305.144565:0:13799:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1783969305.144702:0:13799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1783969305.144757:0:13799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1783969305.144779:0:13799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1783969305.144795:0:13799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783969305.144819:0:13799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.144840:0:13799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9d6d expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.144852:0:13799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.144898:0:13799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cb9d6d expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.144916:0:13799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cb9d6d expref: 20 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969305.144932:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983492d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13799:1870627099234560:0@lo:104: 00000100:00100000:0.0:1783969305.144998:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969305.145059:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8562d300 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.145260:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099234560 00000100:00100000:1.0:1783969305.145267:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099234560 00000100:00100000:1.0:1783969305.145320:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783969305.145329:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:13799:x1870627099234560:12345-0@lo:104: 00010000:00010000:1.0:1783969305.145345:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.145445:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969305.145452:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bfed4274-bbe1-4392-be5b-cfbff577e88d+3:13799:x1870627099234560:12345-0@lo:104: Request processed in 125us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.145460:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1783969305.145483:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969305.145489:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.145498:0:6509:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff93ea813a1a00 is referenced, will be cancelled later 00010000:00010000:1.0:1783969305.145501:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.145508:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969305.145510:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969305.145512:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969305.145667:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983492d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13799:1870627099234560:0@lo:104: 00010000:00010000:0.0:1783969305.145691:0:13799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969305.145977:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13801:1870627099234688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969305.146043:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969305.146163:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.146204:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099234688 00000100:00100000:1.0:1783969305.146210:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099234688 00000100:00100000:1.0:1783969305.146281:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1783969305.146289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:13801:x1870627099234688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.146504:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:13801:x1870627099234688:12345-0@lo:502:llog_process_th.0 Request processed in 215us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.146513:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1783969305.146632:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13801:1870627099234688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969305.146673:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969305.146685:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969305.146688:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783969305.146697:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93e98212a000 00000020:00000080:2.0:1783969305.146700:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783969305.146909:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13801:1870627099234816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969305.146952:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969305.147026:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea990ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.149541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099234816 00000100:00100000:1.0:1783969305.149560:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099234816 00000100:00100000:1.0:1783969305.149632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1783969305.149657:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:13801:x1870627099234816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.150005:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:13801:x1870627099234816:12345-0@lo:502:llog_process_th.0 Request processed in 361us (3050us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.150014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1783969305.150138:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13801:1870627099234816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969305.150183:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969305.150194:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969305.150198:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783969305.150203:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783969305.151317:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783969305.151360:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969305.151374:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11400400000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.151418:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11400400000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.151446:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:1.0:1783969305.151455:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969305.151459:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab70d7000 from 7 10000000:01000000:1.0:1783969305.151462:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969305.151507:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.151517:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.151528:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969305.151569:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099234944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.151660:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.151715:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da780 going to sleep for 11 seconds 00010000:00010000:3.0:1783969305.151850:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969305.151860:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.151869:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a1a00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969305.151879:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.151889:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969305.151898:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969305.151906:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969305.151936:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.151944:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969305.151980:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.151989:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea813a1a00/0xea31253a47cb9d6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cb9d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152005:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969305.152007:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969305.152009:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969305.152020:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969305.152034:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099235072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969305.152073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969305.152113:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099235072 00000100:00100000:3.0:1783969305.152121:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099235072 00010000:00010000:3.0:1783969305.152156:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9d6d expref: 21 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969305.152189:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783969305.152206:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2118450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3649:x1870627099235072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969305.152221:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969305.152227:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cb9d6d expref: 21 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152240:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cb9d6d expref: 21 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152258:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdf000/0xea31253a47cb9d74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cb9d6d expref: 21 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152279:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152289:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152305:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152313:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152319:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152326:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152332:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969305.152337:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152352:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152365:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.152408:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969305.152448:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2118450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3649:x1870627099235072:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969305.152456:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783969305.152537:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099235072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969305.152910:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099234944 00000100:00100000:0.0:1783969305.152916:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099234944 00000100:00100000:0.0:1783969305.152957:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1783969305.152965:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:6518:x1870627099234944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969305.152982:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969305.152999:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdf600/0xea31253a47cb9d89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9d82 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.153024:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdf600/0xea31253a47cb9d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9d82 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.153035:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdf600/0xea31253a47cb9d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9d82 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.153044:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf600, rc 0) 00000100:00100000:0.0:1783969305.153081:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099234944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969305.153088:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00010000:0.0:1783969305.153129:0:13799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.153138:0:13799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969305.153145:0:13799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdf200/0xea31253a47cb9d7b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969305.154553:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099234944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969305.154589:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.154618:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969305.154970:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.155047:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.155107:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da780 going to sleep for 11 seconds 00000100:00100000:3.0:1783969305.155230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099235200 00000100:00100000:3.0:1783969305.155238:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099235200 00000100:00100000:3.0:1783969305.155300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1783969305.155310:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099235200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969305.155492:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099235200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969305.155500:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783969305.156031:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.156092:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.156149:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.156191:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da780 going to sleep for 11 seconds 00000100:00100000:3.0:1783969305.156238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099235328 00000100:00100000:3.0:1783969305.156243:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099235328 00000100:00100000:3.0:1783969305.156282:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1783969305.156289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099235328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969305.156419:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099235328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969305.156427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1783969305.156888:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969305.171607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969305.172757:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073977984 00000100:00100000:1.0:1783969305.172772:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073977984 00000100:00100000:1.0:1783969305.172835:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 352 00000100:00100000:1.0:1783969305.172847:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:6166:x1870627073977984:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969305.172873:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969305.172905:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb9d90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037e5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.172936:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb9d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037e5 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.172947:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb9d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037e5 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.172955:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b601a00, rc 0) 00000100:00100000:1.0:1783969305.173025:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073977984:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 180us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.173029:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 352 00000100:00100000:3.0:1783969305.174192:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13803:1870627099235456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969305.174298:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969305.174358:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.177266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099235456 00000100:00100000:1.0:1783969305.177289:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099235456 00000100:00100000:1.0:1783969305.177377:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1783969305.177728:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:13803:x1870627099235456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.177970:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:13803:x1870627099235456:12345-0@lo:502:llog_process_th.0 Request processed in 246us (3670us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969305.183526:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13803:1870627099235456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969305.183580:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969305.183592:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969305.183594:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783969305.183601:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93eab70d7000 00000020:00000080:2.0:1783969305.183603:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783969305.183703:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969305.183707:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969305.183709:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783969305.183711:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969305.183713:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969305.183715:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783969305.183726:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93eab70d7000 00000020:00000080:2.0:1783969305.183728:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783969305.183793:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13803:1870627099235584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969305.183908:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969305.183952:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea990ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.185472:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1783969305.185557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099235584 00000100:00100000:1.0:1783969305.185567:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099235584 00000100:00100000:1.0:1783969305.185618:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1783969305.185629:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:13803:x1870627099235584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.186128:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:13803:x1870627099235584:12345-0@lo:502:llog_process_th.0 Request processed in 498us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.186139:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1783969305.186803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969305.186838:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073978112 00000100:00100000:1.0:1783969305.186845:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073978112 00000100:00100000:1.0:1783969305.186880:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 355 00000100:00100000:1.0:1783969305.186888:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073978112:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.187060:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073978112:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 172us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.187067:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 355 00000100:00100000:2.0:1783969305.187091:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13803:1870627099235584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969305.187157:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969305.187166:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969305.187168:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783969305.187174:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783969305.187893:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1783969305.187924:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969305.187938:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.187954:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969305.187966:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969305.187969:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab929d800 from 7 10000000:01000000:1.0:1783969305.187972:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969305.188013:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.188026:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.188035:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969305.188057:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.188102:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.188153:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9826460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969305.188154:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099235712 00000100:00100000:2.0:1783969305.188160:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099235712 00000100:00100000:2.0:1783969305.188203:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1783969305.188212:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:6518:x1870627099235712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969305.188225:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969305.188242:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea813a0600/0xea31253a47cb9d9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9d97 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969305.188270:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea813a0600/0xea31253a47cb9d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9d97 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969305.188281:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea813a0600/0xea31253a47cb9d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9d97 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969305.188292:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a0600, rc 0) 00000100:00100000:2.0:1783969305.188339:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099235712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969305.188346:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1783969305.188424:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969305.188436:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.188443:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969305.188489:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.188509:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.188526:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9826460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969305.188542:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099235840 00000100:00100000:2.0:1783969305.188546:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099235840 00000100:00100000:2.0:1783969305.188577:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1783969305.188584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099235840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969305.188793:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099235840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969305.188801:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1783969305.188812:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.188842:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.188886:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.188908:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9826460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969305.188917:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099235968 00000100:00100000:2.0:1783969305.188921:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099235968 00000100:00100000:2.0:1783969305.188950:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1783969305.188957:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099235968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969305.189045:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099235968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969305.189051:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1783969305.189434:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099235968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.189942:0:13806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13806:1870627099236096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.189995:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.190028:0:13806:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982646480 going to sleep for 11 seconds 00000100:00100000:3.0:1783969305.190366:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099236096 00000100:00100000:3.0:1783969305.190371:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099236096 00000100:00100000:3.0:1783969305.190437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1783969305.190446:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:13806:x1870627099236096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969305.190562:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:13806:x1870627099236096:12345-0@lo:502:llog_process_th.0 Request processed in 117us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969305.190570:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1783969305.191155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969305.191251:0:13806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13806:1870627099236096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969305.191285:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969305.191297:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969305.191299:0:13806:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783969305.191308:0:13806:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93eab929d800 00000020:00000080:1.0:1783969305.191316:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783969305.191403:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1783969305.191835:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073978240 00000100:00100000:3.0:1783969305.191842:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073978240 00000100:00100000:3.0:1783969305.191886:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 360 00000100:00100000:3.0:1783969305.191895:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073978240:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969305.192019:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073978240:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 124us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969305.192026:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 360 00000020:00000080:1.0:1783969305.192511:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969305.192515:0:13806:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783969305.192523:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969305.192530:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969305.192531:0:13806:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783969305.192536:0:13806:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93eab929d800 00000020:00000080:1.0:1783969305.192539:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783969305.192624:0:13806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13806:1870627099236224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.194621:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969305.194693:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099236224 00000100:00100000:0.0:1783969305.194703:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099236224 00000100:00100000:0.0:1783969305.194760:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1783969305.194771:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:13806:x1870627099236224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969305.194997:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2142c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:13806:x1870627099236224:12345-0@lo:502:llog_process_th.0 Request processed in 228us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969305.195006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1783969305.195891:0:13806:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982646480 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.195934:0:13806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13806:1870627099236224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969305.195981:0:13806:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969305.195994:0:13806:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969305.195997:0:13806:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783969305.196003:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:3.0:1783969305.196700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000020:01000000:3.0:1783969305.197030:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783969305.197062:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969305.197079:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.197093:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969305.197106:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969305.197116:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93ea912c9800 from 7 10000000:01000000:3.0:1783969305.197119:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969305.197163:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.197172:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969305.197184:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969305.197210:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099236352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969305.197268:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969305.197293:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7540 going to sleep for 11 seconds 00000100:00100000:3.0:1783969305.197314:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073978368 00000100:00100000:3.0:1783969305.197320:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073978368 00000100:00100000:3.0:1783969305.197358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099236352 00000100:00100000:3.0:1783969305.197361:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099236352 00000100:00100000:3.0:1783969305.197376:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 362 00000100:00100000:3.0:1783969305.197470:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:10792:x1870627073978368:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783969305.197618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2141050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:10792:x1870627073978368:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 149us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.197662:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1783969305.197687:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:6518:x1870627099236352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969305.197698:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969305.197724:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb9dac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9da5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.197759:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb9dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9da5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.197772:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb9dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9da5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.197782:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b601c00, rc 0) 00000100:00100000:1.0:1783969305.197830:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099236352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.197838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1783969305.198004:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099236352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969305.198020:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.198030:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969305.198098:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099236480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.198126:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.198140:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982646600 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.198151:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099236480 00000100:00100000:1.0:1783969305.198154:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099236480 00000100:00100000:1.0:1783969305.198172:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1783969305.198177:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099236480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.198279:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099236480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.198286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1783969305.198313:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099236480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.198342:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099236608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.198447:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.198460:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982646600 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.198470:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099236608 00000100:00100000:1.0:1783969305.198473:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099236608 00000100:00100000:1.0:1783969305.198496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1783969305.198501:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099236608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.198577:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099236608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.198583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1783969305.198619:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099236608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.198840:0:13809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13809:1870627099236736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.198874:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.198891:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099236736 00000100:00100000:1.0:1783969305.198894:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099236736 00000100:00100000:1.0:1783969305.198911:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1783969305.198915:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:13809:x1870627099236736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.198983:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:13809:x1870627099236736:12345-0@lo:502:llog_process_th.0 Request processed in 66us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.198990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1783969305.199018:0:13809:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982646300 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.199030:0:13809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13809:1870627099236736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969305.199051:0:13809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969305.199063:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969305.199066:0:13809:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783969305.199076:0:13809:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ea912c9800 00000020:00000080:1.0:1783969305.199079:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783969305.199149:0:13809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969305.199152:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969305.199155:0:13809:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783969305.199158:0:13809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969305.199167:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969305.199168:0:13809:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783969305.199174:0:13809:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ea912c9800 00000020:00000080:1.0:1783969305.199176:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783969305.199217:0:13809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13809:1870627099236864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.199265:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969305.199283:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099236864 00000100:00100000:1.0:1783969305.199286:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099236864 00000100:00100000:1.0:1783969305.199306:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1783969305.199312:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:13809:x1870627099236864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969305.199376:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2143850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:13809:x1870627099236864:12345-0@lo:502:llog_process_th.0 Request processed in 61us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.199408:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1783969305.199453:0:13809:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982646300 going to sleep for 11 seconds 00000100:00100000:1.0:1783969305.199467:0:13809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13809:1870627099236864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969305.199490:0:13809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969305.199494:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969305.199496:0:13809:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783969305.199501:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783969305.199560:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1783969305.199592:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969305.199603:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.199613:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969305.203719:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783969305.204948:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 362 00000100:00100000:2.0:1783969305.205334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969305.205661:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073978496 00000100:00100000:0.0:1783969305.205673:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073978496 00000100:00100000:0.0:1783969305.205728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 368 00000100:00100000:0.0:1783969305.205741:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:10792:x1870627073978496:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969305.205990:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:10792:x1870627073978496:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 251us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969305.205999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 368 00000100:00100000:1.0:1783969305.216361:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969305.216442:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073978624 00000100:00100000:1.0:1783969305.216454:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073978624 00000100:00100000:1.0:1783969305.216519:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 369 00000100:00100000:1.0:1783969305.216531:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:6166:x1870627073978624:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969305.216554:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969305.216578:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9db3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037ec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.216615:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037ec expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.216628:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037ec expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969305.216638:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b601200, rc 0) 00000100:00100000:1.0:1783969305.216728:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2140050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073978624:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 197us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.216736:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 369 00000100:00100000:0.0:1783969305.228984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969305.229036:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073978752 00000100:00100000:0.0:1783969305.229050:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073978752 00000100:00100000:0.0:1783969305.229115:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 370 00000100:00100000:0.0:1783969305.229126:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073978752:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969305.229327:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea997d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073978752:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 201us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969305.229336:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 370 00000100:00100000:1.0:1783969305.238190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969305.238312:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073978880 00000100:00100000:3.0:1783969305.238327:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073978880 00000100:00100000:1.0:1783969305.238521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 371 00000100:00100000:1.0:1783969305.238537:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073978880:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969305.238803:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:6166:x1870627073978880:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 271us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969305.238813:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 371 00000100:00100000:1.0:1783969305.244488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969305.244928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073979008 00000100:00100000:0.0:1783969305.244948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073979008 00000100:00100000:0.0:1783969305.245015:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 372 00000100:00100000:0.0:1783969305.245026:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:10795:x1870627073979008:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969305.245215:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:10795:x1870627073979008:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 190us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969305.245224:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 372 00000040:00080000:2.0:1783969305.263125:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783969305.264326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969305.264469:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073979136 00000100:00100000:0.0:1783969305.264483:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073979136 00000100:00100000:0.0:1783969305.264559:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 373 00000100:00100000:0.0:1783969305.264574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:10795:x1870627073979136:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969305.264790:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea83247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:10795:x1870627073979136:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 219us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969305.264799:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 373 00010000:00010000:1.0:1783969305.393909:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969306.225734:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783969306.289480:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783969306.390322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969306.390410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969306.390453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969306.390485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969306.390513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969306.390540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969306.390583:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073979520 00000100:00100000:0.0:1783969306.390595:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073979520 00000100:00100000:0.0:1783969306.390685:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073979776 00000100:00100000:0.0:1783969306.390688:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073979776 00000100:00100000:0.0:1783969306.391265:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073979392 00000100:00100000:0.0:1783969306.391271:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073979392 00000100:00100000:0.0:1783969306.391294:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073979904 00000100:00100000:0.0:1783969306.391296:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073979904 00000100:00100000:0.0:1783969306.391348:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 247 00000100:00100000:0.0:1783969306.391363:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073979520:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969306.391500:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073979520:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 140us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969306.391509:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 247 00000100:00100000:0.0:1783969306.391529:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 248 00000100:00100000:0.0:1783969306.391536:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073979776:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969306.391560:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073979776:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969306.391567:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 248 00000100:00100000:0.0:1783969306.391577:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 249 00000100:00100000:0.0:1783969306.391582:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073979392:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969306.391605:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073979392:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969306.391611:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 249 00000100:00100000:0.0:1783969306.391620:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 250 00000100:00100000:0.0:1783969306.391639:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073979904:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969306.391662:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073979904:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969306.391668:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 250 00000100:00080000:0.0:1783969306.391693:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969306.391697:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969306.392105:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073979264 00000100:00100000:1.0:1783969306.392121:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073979264 00000100:00100000:1.0:1783969306.392172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 374 00000100:00100000:1.0:1783969306.392180:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073979264:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969306.392218:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073979264:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969306.392225:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 374 00000100:00100000:1.0:1783969306.392266:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073979648 00000100:00100000:1.0:1783969306.392270:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073979648 00000100:00100000:1.0:1783969306.399369:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:1.0:1783969306.399431:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073979648:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969306.399548:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073979648:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 135us (9031us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969306.399556:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00080000:0.0:1783969306.402445:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783969306.418970:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783969307.120560:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969307.120578:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e98212a000 from 10 10000000:01000000:1.0:1783969307.120588:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969307.120695:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969307.120711:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969307.120723:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969307.120760:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099236992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969307.121084:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969307.121187:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969307.122310:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099236992 00000100:00100000:2.0:1783969307.122328:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099236992 00000100:00100000:2.0:1783969307.122414:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1783969307.122584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:6518:x1870627099236992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969307.122609:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969307.122641:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9dc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cb9dba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969307.122674:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cb9dba expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969307.122719:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cb9dba expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969307.122731:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a0200, rc 0) 00000100:00100000:2.0:1783969307.122827:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099236992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 394us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969307.122835:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1783969307.122966:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099236992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969307.122989:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969307.123012:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969307.123116:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099237120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969307.123155:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969307.123204:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969307.124991:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099237120 00000100:00100000:2.0:1783969307.125009:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099237120 00000100:00100000:2.0:1783969307.125099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1783969307.125123:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099237120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969307.125907:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099237120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969307.125985:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099237248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969307.126064:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969307.126094:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969307.126661:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099237248 00000100:00100000:3.0:1783969307.126670:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099237248 00000100:00100000:3.0:1783969307.126726:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1783969307.126736:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:6518:x1870627099237248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969307.126887:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+25:6518:x1870627099237248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969307.126895:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1783969307.127276:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:6518:x1870627099237120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969307.127287:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1783969307.128251:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfed4274-bbe1-4392-be5b-cfbff577e88d:6518:1870627099237248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969307.129092:0:13827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13827:1870627099237376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969307.129202:0:13827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969307.129258:0:13827:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7280180 going to sleep for 11 seconds 00000100:00100000:3.0:1783969307.129439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099237376 00000100:00100000:3.0:1783969307.129453:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099237376 00000100:00100000:3.0:1783969307.129510:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1783969307.129521:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:13827:x1870627099237376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969307.129700:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:13827:x1870627099237376:12345-0@lo:502:llog_process_th.0 Request processed in 172us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969307.129709:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1783969307.130006:0:13827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13827:1870627099237376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969307.130045:0:13827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969307.130056:0:13827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969307.130059:0:13827:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783969307.130067:0:13827:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93e98212a000 00000020:00000080:1.0:1783969307.130070:0:13827:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783969307.130193:0:13827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13827:1870627099237504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969307.130240:0:13827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969307.130284:0:13827:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9826466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969307.134365:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099237504 00000100:00100000:2.0:1783969307.134409:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099237504 00000100:00100000:2.0:1783969307.134508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1783969307.134521:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:13827:x1870627099237504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969307.134768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:13827:x1870627099237504:12345-0@lo:502:llog_process_th.0 Request processed in 249us (4526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969307.134778:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1783969307.135150:0:13827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfed4274-bbe1-4392-be5b-cfbff577e88d:13827:1870627099237504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969307.135216:0:13827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969307.135227:0:13827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969307.135230:0:13827:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783969307.135236:0:13827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1783969307.138304:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1783969307.138364:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969307.138441:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969307.138491:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969307.440837:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783969308.020794:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:1.0:1783969308.464601:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969308.534983:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e982421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099237632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969308.535077:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969308.535245:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099237632 00000100:00100000:2.0:1783969308.535253:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099237632 00000100:00100000:2.0:1783969308.535309:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783969308.535318:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099237632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783969308.535355:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783969308.536282:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099237632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 960us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969308.536292:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783969308.536369:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e982421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099237632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969309.044492:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969309.044516:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099237760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969309.044609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969309.044849:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099237760 00000100:00100000:1.0:1783969309.044857:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099237760 00000100:00100000:1.0:1783969309.044934:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783969309.044945:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099237760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969309.044980:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969309.045039:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099237760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969309.045047:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783969309.045133:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099237760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783969309.488981:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969309.552680:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969309.552714:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099237888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969309.552797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969309.553029:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099237888 00000100:00100000:3.0:1783969309.553049:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099237888 00000100:00100000:3.0:1783969309.553118:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783969309.553128:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099237888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969309.553156:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969309.553201:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099237888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969309.553208:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783969309.553539:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969309.553549:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099238016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969309.553588:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969309.553614:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099238016 00000100:00100000:3.0:1783969309.553618:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099238016 00000100:00100000:3.0:1783969309.553640:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783969309.553646:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099238016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783969309.553656:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969309.553681:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099238016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969309.553687:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783969309.553726:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099238144:0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.553730:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099238400:0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.553764:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969309.553770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969309.553785:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099238656:0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.553785:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099238912:0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.553807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969309.553808:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969309.553821:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099239168:0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.553823:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783969309.553827:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099238272:0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.553841:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969309.553876:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099238016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969309.553891:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00080000:1.0:1783969309.553895:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969309.553905:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099238528:0@lo:400:kworker.0 00000100:00100000:0.0:1783969309.554009:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099238656 00000100:00100000:0.0:1783969309.554014:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099238656 00000100:00100000:0.0:1783969309.554048:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099239168 00000100:00100000:0.0:1783969309.554051:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099239168 00000100:00100000:0.0:1783969309.554072:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783969309.554079:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099238656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.554110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969309.554130:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099238784:0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.554153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969309.554168:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099239296:0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.554197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969309.554218:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969309.554218:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099238144 00000100:00100000:2.0:1783969309.554222:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099238144 00000100:00100000:3.0:1783969309.554228:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099239040:0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.554248:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1783969309.554249:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969309.554254:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099238144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.554272:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099238272 00000100:00100000:2.0:1783969309.554285:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099238144:12345-0@lo:400:kworker.0 Request processed in 32us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969309.554287:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099238272 00000100:00100000:2.0:1783969309.554292:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1783969309.554303:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099238784 00000100:00100000:3.0:1783969309.554305:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099238784 00000100:00100000:3.0:1783969309.554316:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099239296 00000100:00100000:3.0:1783969309.554318:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099239296 00000100:00100000:2.0:1783969309.554320:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099238912 00000100:00100000:2.0:1783969309.554323:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099238912 00000100:00100000:2.0:1783969309.554344:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099239040 00000100:00100000:2.0:1783969309.554347:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099239040 00000100:00100000:2.0:1783969309.554364:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783969309.554370:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099238912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.554428:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099238912:12345-0@lo:400:kworker.0 Request processed in 58us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969309.554435:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783969309.554445:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783969309.554451:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099239040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.554477:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099239040:12345-0@lo:400:kworker.0 Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969309.554482:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783969309.554498:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099238528 00000100:00100000:2.0:1783969309.554501:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099238528 00000100:00100000:2.0:1783969309.554517:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1783969309.554523:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099239168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.554639:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783969309.554647:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099238272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969309.554852:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1783969309.554858:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ea8e967100, transno 4294967301 00000100:00100000:1.0:1783969309.554874:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099237888:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783969309.554893:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969309.554897:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969309.554900:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969309.554909:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099238400 00000100:00100000:1.0:1783969309.554912:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099238400 00000100:00100000:1.0:1783969309.554940:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783969309.554946:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099238400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.562909:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099238272:12345-0@lo:400:kworker.0 Request processed in 8251us (8786us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969309.562924:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783969309.562961:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783969309.562975:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab734c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099238784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.563031:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab734c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099238784:12345-0@lo:400:kworker.0 Request processed in 62us (8876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969309.563038:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783969309.563052:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1783969309.563058:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099239296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.563088:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099239296:12345-0@lo:400:kworker.0 Request processed in 30us (8890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969309.563094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1783969309.563105:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783969309.563112:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099238528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.563158:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099238528:12345-0@lo:400:kworker.0 Request processed in 48us (8941us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969309.563164:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783969309.563438:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099238528:0@lo:400:kworker.0 00010000:00080000:3.0:1783969309.563455:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a47b80 x1870627099239040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969309.563466:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099239040:0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.563491:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099238144:0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.563505:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099239168:0@lo:400:kworker.0 00000100:00100000:3.0:1783969309.563560:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099238272:0@lo:400:kworker.0 00010000:00080000:3.0:1783969309.563580:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf7fb100 x1870627099238784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969309.563590:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099238784:0@lo:400:kworker.0 00010000:00080000:3.0:1783969309.563602:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff4a80 x1870627099239296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969309.563609:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099239296:0@lo:400:kworker.0 00010000:00080000:3.0:1783969309.563621:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a45c00 x1870627099238912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969309.563628:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099238912:0@lo:400:kworker.0 00000100:00100000:2.0:1783969309.564282:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099239168:12345-0@lo:400:kworker.0 Request processed in 9756us (10437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969309.564298:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1783969309.564444:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099238656:12345-0@lo:400:kworker.0 Request processed in 10365us (10634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969309.564452:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1783969309.564593:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099238656:0@lo:400:kworker.0 00000100:00100000:1.0:1783969309.566720:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099238400:12345-0@lo:400:kworker.0 Request processed in 11766us (12941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969309.566741:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783969309.567907:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099238400:0@lo:400:kworker.0 00000100:00100000:0.0:1783969310.066097:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099239424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969310.066204:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969310.066348:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099239424 00000100:00100000:3.0:1783969310.066368:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099239424 00000100:00100000:3.0:1783969310.066460:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783969310.066476:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099239424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969310.066505:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969310.066549:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099239424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969310.066557:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783969310.067482:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969310.067496:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099239552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969310.067538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969310.067924:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099239552 00000100:00100000:2.0:1783969310.067930:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099239552 00000100:00100000:2.0:1783969310.067973:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969310.067981:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099239552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969310.068005:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969310.068043:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099239552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969310.068050:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1783969310.068218:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981ac9180 x1870627099239424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969310.068237:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099239424:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1783969310.068318:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837cc380 x1870627099239552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969310.068331:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099239552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783969310.520206:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969311.502179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969311.502281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969311.502316:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969311.502338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969311.502362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969311.502502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969311.502537:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073980288 00000100:00100000:0.0:1783969311.502557:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073980288 00000100:00100000:0.0:1783969311.502618:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073980544 00000100:00100000:0.0:1783969311.502622:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073980544 00000100:00100000:0.0:1783969311.502640:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073980160 00000100:00100000:0.0:1783969311.502649:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073980160 00000100:00100000:0.0:1783969311.502663:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073980672 00000100:00100000:0.0:1783969311.502665:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073980672 00000100:00100000:0.0:1783969311.502693:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 257 00000100:00100000:0.0:1783969311.502708:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073980288:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969311.502777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073980288:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 76us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969311.502785:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 257 00000100:00100000:0.0:1783969311.502802:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 258 00000100:00100000:0.0:1783969311.502808:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073980544:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969311.502833:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073980544:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969311.502839:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 258 00000100:00100000:0.0:1783969311.502849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 259 00000100:00100000:0.0:1783969311.502855:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073980160:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969311.502878:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073980160:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969311.502884:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 259 00000100:00100000:0.0:1783969311.502895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 260 00000100:00100000:0.0:1783969311.502901:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073980672:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969311.502925:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073980672:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969311.502931:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 260 00000100:00100000:2.0:1783969311.504168:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073980416 00000100:00100000:2.0:1783969311.504177:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073980416 00000100:00100000:2.0:1783969311.504229:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:2.0:1783969311.504237:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e982421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073980416:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969311.504285:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e982421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073980416:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 49us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969311.504291:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00080000:1.0:1783969311.504820:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969311.504825:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969311.504828:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969311.509988:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073980032 00000100:00100000:3.0:1783969311.510002:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073980032 00000100:00100000:3.0:1783969311.510141:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 381 00000100:00100000:3.0:1783969311.510152:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073980032:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969311.510241:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073980032:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 92us (8072us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969311.510250:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 381 00010000:00010000:1.0:1783969311.537626:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969312.560936:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969313.584579:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969313.650294:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099239680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969313.650364:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969313.650442:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099239680 00000100:00100000:2.0:1783969313.650451:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099239680 00000100:00100000:2.0:1783969313.650517:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783969313.650527:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099239680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783969313.650562:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783969313.650625:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099239680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969313.650633:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783969313.651841:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099239680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969314.160859:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099239808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969314.160946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969314.161441:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099239808 00000100:00100000:3.0:1783969314.161449:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099239808 00000100:00100000:3.0:1783969314.161546:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783969314.161557:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099239808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969314.161592:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783969314.161649:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099239808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.161667:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783969314.161743:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099239808:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783969314.608764:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969314.672628:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969314.672658:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099239936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969314.672739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969314.672791:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099240320:0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.672981:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099240064:0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.673019:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969314.673034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969314.673045:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98360a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099240576:0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.673055:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099240832:0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.673070:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969314.673076:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969314.673085:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099241088:0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.673091:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783969314.673095:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099240448:0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.673102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969314.673114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969314.673115:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783969314.673119:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099240192:0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.673127:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099240960:0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.673137:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969314.673144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969314.673152:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099240704:0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.673169:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969314.673171:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099240064 00000100:00100000:3.0:1783969314.673177:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099240064 00000100:00100000:1.0:1783969314.673183:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099241344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969314.673203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969314.673224:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1783969314.673228:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099239936 00000100:00100000:1.0:1783969314.673231:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099239936 00000100:00100000:3.0:1783969314.673233:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099240064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.673261:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099241344 00000100:00100000:1.0:1783969314.673264:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099241344 00000100:00100000:1.0:1783969314.673279:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783969314.673281:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099240064:12345-0@lo:400:kworker.0 Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.673288:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1783969314.673292:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099239936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969314.673314:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969314.673317:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099240832 00000100:00100000:3.0:1783969314.673320:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099240832 00000100:00100000:3.0:1783969314.673343:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099240960 00000100:00100000:3.0:1783969314.673346:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099240960 00000100:00100000:1.0:1783969314.673349:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099239936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969314.673355:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783969314.673362:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783969314.673366:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783969314.673368:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099240832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.673370:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099241344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969314.673398:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969314.673422:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099240832:12345-0@lo:400:kworker.0 Request processed in 53us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969314.673422:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099241344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.673428:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783969314.673428:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783969314.673439:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783969314.673445:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099240960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.673445:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099240576 00000100:00100000:1.0:1783969314.673448:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099240576 00000100:00100000:3.0:1783969314.673470:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099240960:12345-0@lo:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969314.673471:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099241088 00000100:00100000:1.0:1783969314.673473:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099241088 00000100:00100000:3.0:1783969314.673476:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783969314.673485:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099240448 00000100:00100000:1.0:1783969314.673499:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099240448 00000100:00100000:1.0:1783969314.673512:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099240192 00000100:00100000:1.0:1783969314.673515:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099240192 00000100:00100000:3.0:1783969314.673519:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099240704 00000100:00100000:3.0:1783969314.673522:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099240704 00000100:00100000:1.0:1783969314.673526:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1783969314.673531:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099240576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.673538:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783969314.673543:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099241088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969314.673563:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099240576:12345-0@lo:400:kworker.0 Request processed in 31us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.673564:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099241088:12345-0@lo:400:kworker.0 Request processed in 22us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969314.673569:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783969314.673795:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783969314.673869:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783969314.673879:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099240448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969314.673893:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783969314.673901:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099240192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.673910:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099240448:12345-0@lo:400:kworker.0 Request processed in 35us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.673916:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783969314.673927:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783969314.673930:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099240192:12345-0@lo:400:kworker.0 Request processed in 30us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.673933:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099240704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969314.673935:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1783969314.673954:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969314.673958:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969314.673961:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969314.673963:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969314.673974:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099240320 00000100:00100000:2.0:1783969314.673977:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099240320 00000100:00100000:2.0:1783969314.674004:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783969314.674010:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099240320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.674020:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099240704:12345-0@lo:400:kworker.0 Request processed in 87us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.674026:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783969314.674038:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099240320:12345-0@lo:400:kworker.0 Request processed in 29us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969314.674044:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783969314.674061:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099241216:0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.674088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969314.674104:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099240192:0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.674111:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099240448:0@lo:400:kworker.0 00010000:00080000:2.0:1783969314.674118:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98360aa00 x1870627099240704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783969314.674120:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983608700 x1870627099240960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969314.674129:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099240704:0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.674130:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099240960:0@lo:400:kworker.0 00010000:00080000:3.0:1783969314.674140:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983608380 x1870627099240832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969314.674145:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099241344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969314.674148:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099240832:0@lo:400:kworker.0 00000100:00100000:2.0:1783969314.674153:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099240064:0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.674156:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099240320:0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.674169:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099239936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969314.674172:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98360a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099240576:0@lo:400:kworker.0 00000100:00100000:2.0:1783969314.674180:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099241088:0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.674198:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099241216 00000100:00100000:3.0:1783969314.674201:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099241216 00000100:00080000:2.0:1783969314.674223:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969314.674227:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783969314.674233:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099241216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969314.674322:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099241216:12345-0@lo:400:kworker.0 Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.674328:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00080000:2.0:1783969314.674369:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98360a680 x1870627099241216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969314.674375:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099241216:0@lo:400:kworker.0 00000100:00100000:0.0:1783969315.185583:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099241472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969315.185665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969315.185788:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099241472 00000100:00100000:2.0:1783969315.185796:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099241472 00000100:00100000:2.0:1783969315.185901:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783969315.185912:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099241472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969315.185942:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969315.185993:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099241472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969315.186001:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1783969315.186049:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98360a680 x1870627099241472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969315.186068:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099241472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969315.186355:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099241600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969315.186410:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969315.186521:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099241600 00000100:00100000:0.0:1783969315.186526:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099241600 00000100:00100000:0.0:1783969315.186559:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783969315.186566:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099241600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969315.186577:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969315.186759:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099241600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 192us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969315.186765:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1783969315.186812:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981a47b80 x1870627099241600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969315.186826:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099241600:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783969315.638986:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969316.468828:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1783969316.529085:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783969316.626026:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969316.626069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969316.626081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073980800 00000100:00100000:3.0:1783969316.626091:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073980800 00000100:00100000:2.0:1783969316.626111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969316.626139:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 383 00000100:00100000:3.0:1783969316.626149:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2393:x1870627073980800:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969316.626225:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2393:x1870627073980800:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969316.626247:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 383 00000100:00100000:0.0:1783969316.626333:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073981056 00000100:00100000:0.0:1783969316.626337:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073981056 00000100:00100000:0.0:1783969316.626441:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073980928 00000100:00100000:0.0:1783969316.626445:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073980928 00000100:00100000:2.0:1783969316.626465:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 267 00000100:00100000:2.0:1783969316.626475:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073981056:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969316.626481:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 268 00000100:00100000:0.0:1783969316.626487:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073980928:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969316.626513:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073981056:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 41us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969316.626520:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 267 00000100:00080000:3.0:1783969316.626539:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969316.626548:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969316.628772:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073980928:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 2273us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969316.628787:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 268 00000100:00100000:2.0:1783969316.653601:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969316.653695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969316.653793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969316.659258:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073981184 00000100:00100000:3.0:1783969316.659283:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073981184 00000100:00100000:3.0:1783969316.659361:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1783969316.659371:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2390:x1870627073981184:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:3.0:1783969316.659413:0:8439:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9cda 00000100:00080000:3.0:1783969316.659422:0:8439:0:(import.c:65:import_set_state_nolock()) ffff93eabf7bd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783969316.659476:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1783969316.659769:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+2:2390:x1870627073981184:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 398us (6176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969316.659778:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00010000:00010000:3.0:1783969316.659808:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783969316.659815:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783969316.662481:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969316.668077:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073981312 00000100:00100000:1.0:1783969316.668100:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073981312 00000100:00100000:1.0:1783969316.668184:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073981440 00000100:00100000:1.0:1783969316.668188:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073981440 00000100:00100000:1.0:1783969316.668241:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 269 00000100:00100000:1.0:1783969316.668251:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073981312:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969316.668333:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073981312:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 84us (14638us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969316.668340:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 269 00000100:00100000:1.0:1783969316.668358:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 270 00000100:00100000:1.0:1783969316.668364:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073981440:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969316.668407:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073981440:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 42us (14614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969316.668413:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 270 00000100:00080000:3.0:1783969316.668834:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969316.668840:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783969317.680596:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969318.704984:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969318.768630:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099241728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969318.768700:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969318.768928:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099241728 00000100:00100000:3.0:1783969318.768937:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099241728 00000100:00100000:3.0:1783969318.768995:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783969318.769005:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099241728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969318.769038:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783969318.769093:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099241728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969318.769100:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783969318.770804:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099241728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969319.280929:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969319.280953:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099241856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969319.281023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969319.281275:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099241856 00000100:00100000:3.0:1783969319.281295:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099241856 00000100:00100000:3.0:1783969319.281349:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783969319.281359:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099241856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969319.281426:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783969319.281483:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099241856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969319.281491:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783969319.281668:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099241856:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783969319.728573:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969319.792959:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099241984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969319.793035:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969319.793173:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099241984 00000100:00100000:1.0:1783969319.793181:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099241984 00000100:00100000:1.0:1783969319.793247:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783969319.793259:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099241984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969319.793289:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969319.793335:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099241984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969319.793342:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1783969319.793489:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969319.793525:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099241984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969319.793926:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099242112:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.793962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.793992:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099242624:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794031:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099243136:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794080:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783969319.794086:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099242240:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794119:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099242752:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794136:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794147:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099243264:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794204:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099242624 00000100:00100000:2.0:1783969319.794208:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099242624 00000100:00100000:2.0:1783969319.794242:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099243136 00000100:00100000:2.0:1783969319.794244:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099243136 00000100:00100000:2.0:1783969319.794255:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099242240 00000100:00100000:2.0:1783969319.794258:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099242240 00000100:00100000:2.0:1783969319.794267:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099242752 00000100:00100000:2.0:1783969319.794269:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099242752 00000100:00100000:2.0:1783969319.794280:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099243264 00000100:00100000:2.0:1783969319.794282:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099243264 00000100:00100000:2.0:1783969319.794293:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783969319.794299:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099242624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794336:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099242624:12345-0@lo:400:kworker.0 Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.794342:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783969319.794356:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1783969319.794361:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099243136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794443:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099243136:12345-0@lo:400:kworker.0 Request processed in 81us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.794449:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1783969319.794461:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1783969319.794474:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099242240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794501:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099242240:12345-0@lo:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.794507:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1783969319.794517:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783969319.794523:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099242752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794545:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099242752:12345-0@lo:400:kworker.0 Request processed in 23us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.794550:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783969319.794562:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1783969319.794567:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099243264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794589:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099243264:12345-0@lo:400:kworker.0 Request processed in 22us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.794594:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:2.0:1783969319.794608:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969319.794611:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969319.794629:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099242240:0@lo:400:kworker.0 00010000:00080000:2.0:1783969319.794640:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d3480 x1870627099242752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969319.794650:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099242752:0@lo:400:kworker.0 00010000:00080000:2.0:1783969319.794659:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d2d80 x1870627099243264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969319.794667:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099243264:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794675:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099242624:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794691:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099243136:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794714:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099242496:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794751:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099243008:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794788:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783969319.794793:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099242368:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794831:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099242880:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794851:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794867:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099243392:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.794885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.794907:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099243008 00000100:00100000:2.0:1783969319.794911:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099243008 00000100:00100000:2.0:1783969319.794939:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099242880 00000100:00100000:2.0:1783969319.794942:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099242880 00000100:00100000:2.0:1783969319.794952:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099243392 00000100:00100000:2.0:1783969319.794954:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099243392 00000100:00100000:2.0:1783969319.794965:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783969319.794971:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099243008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.795004:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099243008:12345-0@lo:400:kworker.0 Request processed in 33us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.795010:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783969319.795020:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783969319.795026:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099242880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.795059:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099242880:12345-0@lo:400:kworker.0 Request processed in 34us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.795065:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783969319.795075:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783969319.795081:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099243392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.795102:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099243392:12345-0@lo:400:kworker.0 Request processed in 22us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.795107:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1783969319.795123:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969319.795126:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969319.795131:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099242496 00000100:00100000:2.0:1783969319.795134:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099242496 00000100:00100000:2.0:1783969319.795148:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783969319.795153:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099242496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.795178:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099242496:12345-0@lo:400:kworker.0 Request processed in 24us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.795183:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:2.0:1783969319.795205:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d3b80 x1870627099242880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969319.795214:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099242880:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.795223:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099243392:0@lo:400:kworker.0 00000100:00100000:2.0:1783969319.795230:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099242496:0@lo:400:kworker.0 00010000:00080000:2.0:1783969319.795238:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d1f80 x1870627099243008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969319.795245:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099243008:0@lo:400:kworker.0 00000100:00100000:3.0:1783969319.795578:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099242368 00000100:00100000:3.0:1783969319.795582:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099242368 00000100:00100000:3.0:1783969319.795612:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783969319.795617:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099242368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969319.795656:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099242368:12345-0@lo:400:kworker.0 Request processed in 38us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969319.795661:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783969319.795700:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099242368:0@lo:400:kworker.0 00000100:00100000:0.0:1783969319.795930:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099242112 00000100:00100000:0.0:1783969319.795935:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099242112 00000100:00100000:0.0:1783969319.795974:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1783969319.795981:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099242112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969319.796017:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099242112:12345-0@lo:400:kworker.0 Request processed in 37us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969319.796029:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1783969319.796073:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099242112:0@lo:400:kworker.0 00000100:00100000:3.0:1783969319.796421:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969319.796444:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099243520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969319.796479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.799015:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099243520 00000100:00100000:2.0:1783969319.799029:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099243520 00000100:00100000:2.0:1783969319.799098:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783969319.799108:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099243520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783969319.799138:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969319.799231:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099243520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.799239:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783969319.799431:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099243520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969320.305570:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099243648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969320.305640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969320.305965:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099243648 00000100:00100000:1.0:1783969320.305972:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099243648 00000100:00100000:1.0:1783969320.306027:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783969320.306037:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099243648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969320.306081:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969320.306138:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099243648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969320.306145:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:0.0:1783969320.306630:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983609c00 x1870627099243648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969320.306651:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099243648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969320.306667:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969320.306674:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099243776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969320.306702:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969320.306921:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099243776 00000100:00100000:2.0:1783969320.306926:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099243776 00000100:00100000:2.0:1783969320.306962:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783969320.306970:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099243776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969320.306983:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969320.307024:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099243776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969320.307031:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:0.0:1783969320.307426:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e981aca680 x1870627099243776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969320.307440:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e981aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099243776:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783969320.756406:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969321.740931:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969321.741061:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073981696 00000100:00100000:0.0:1783969321.741073:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073981696 00000100:00100000:0.0:1783969321.741176:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 277 00000100:00100000:0.0:1783969321.741191:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073981696:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969321.741298:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073981696:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 110us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969321.741307:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 277 00000100:00080000:3.0:1783969321.741854:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969321.741931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969321.741965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969321.741994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969321.742069:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073981824 00000100:00100000:2.0:1783969321.742075:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073981824 00000100:00100000:2.0:1783969321.742117:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073982080 00000100:00100000:2.0:1783969321.742121:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073982080 00000100:00100000:2.0:1783969321.742141:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 278 00000100:00100000:2.0:1783969321.742149:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073981824:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969321.742200:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627073981824:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969321.742207:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 278 00000100:00100000:2.0:1783969321.742237:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 279 00000100:00100000:2.0:1783969321.742251:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073982080:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969321.742278:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627073982080:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969321.742285:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 279 00000100:00080000:0.0:1783969321.742577:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969321.742666:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073981568 00000100:00100000:3.0:1783969321.742671:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073981568 00000100:00100000:3.0:1783969321.742714:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 385 00000100:00100000:3.0:1783969321.742721:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073981568:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969321.742763:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627073981568:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 43us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969321.742778:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 385 00000100:00100000:0.0:1783969321.745884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969321.746006:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073981952 00000100:00100000:2.0:1783969321.746018:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073981952 00000100:00100000:2.0:1783969321.746112:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 280 00000100:00100000:2.0:1783969321.746124:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073981952:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:0.0:1783969321.746302:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969321.746442:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073981952:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 318us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969321.746521:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 280 00010000:00010000:3.0:1783969321.776805:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969322.800628:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783969322.868353:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:0.0:1783969322.868376:0:9517:0:(genops.c:906:class_export_put()) final put ffff93eabf7bc000/c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:3.0:1783969322.870582:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93eabf7bc000/c481ab09-d97e-4adb-b42e-68f98b038d20 for lustre-OST0001 00000020:00000080:3.0:1783969322.870706:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eabf7bd800 for lustre-OST0001 00010000:00010000:2.0:1783969323.824920:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969323.888703:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099243904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969323.888810:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969323.890532:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099243904 00000100:00100000:1.0:1783969323.890551:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099243904 00000100:00100000:0.0:1783969323.895236:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783969323.895270:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099243904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969323.895329:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783969323.896240:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099243904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 982us (7424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969323.896269:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783969323.896462:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099243904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969324.401138:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099244032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969324.401242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.401760:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099244032 00000100:00100000:1.0:1783969324.401772:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099244032 00000100:00100000:1.0:1783969324.401850:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783969324.402473:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099244032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969324.402589:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969324.404764:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099244032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2889us (3507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.404794:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783969324.417762:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099244032:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783969324.850697:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969324.912964:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969324.913050:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969324.913091:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099244288:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.913201:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969324.913247:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099244416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969324.913283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.913287:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099244288 00000100:00100000:1.0:1783969324.913297:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099244288 00000100:00100000:2.0:1783969324.913312:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969324.913317:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099244544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969324.913351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969324.913396:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099244416 00000100:00100000:2.0:1783969324.913401:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099244416 00000100:00100000:1.0:1783969324.913405:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1783969324.913415:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099244288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969324.913443:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099244544 00000100:00100000:2.0:1783969324.913446:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099244544 00000100:00100000:2.0:1783969324.913462:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783969324.913467:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099244416:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969324.913478:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099244288:12345-0@lo:400:kworker.0 Request processed in 64us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.913485:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00002000:00000024:2.0:1783969324.913506:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969324.913538:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099244288:0@lo:400:kworker.0 00000100:00100000:2.0:1783969324.913543:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099244416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (260us total) trans 0 rc 0/0 00000100:00080000:1.0:1783969324.913598:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969324.913638:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783969324.913733:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783969324.913742:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099244544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969324.913754:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969324.913783:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099244544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.913790:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783969324.913845:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099244544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969324.913859:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099244416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969324.915086:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099244160:0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.915164:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969324.917820:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099244160 00000100:00100000:2.0:1783969324.917842:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099244160 00000100:00100000:2.0:1783969324.917943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1783969324.917957:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099244160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969324.918095:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099244160:12345-0@lo:400:kworker.0 Request processed in 141us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969324.918104:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1783969324.918705:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099244160:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.919059:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099244800:0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.919065:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099244928:0@lo:400:kworker.0 00000100:00100000:0.0:1783969324.919138:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099245056:0@lo:400:kworker.0 00000100:00100000:2.0:1783969324.919177:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099244672:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.919297:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.920135:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099245312:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.920180:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.920234:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099244800 00000100:00100000:1.0:1783969324.920241:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099244800 00000100:00100000:1.0:1783969324.920297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783969324.920306:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099244800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.930154:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099244800:12345-0@lo:400:kworker.0 Request processed in 9832us (10841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.930176:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783969324.930294:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099244800:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.930511:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099245312 00000100:00100000:1.0:1783969324.930519:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099245312 00000100:00100000:1.0:1783969324.930597:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783969324.930607:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099245312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.930681:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099245312:12345-0@lo:400:kworker.0 Request processed in 76us (10500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.930707:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1783969324.930726:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783969324.930752:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d3480 x1870627099245312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969324.930765:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099245312:0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.931031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969324.931088:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099245440:0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.931132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969324.931162:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099245440 00000100:00100000:3.0:1783969324.931167:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099245440 00000100:00100000:3.0:1783969324.931199:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783969324.931206:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099245440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.931243:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099245440:12345-0@lo:400:kworker.0 Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969324.931249:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1783969324.931270:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783969324.931286:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d0e00 x1870627099245440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969324.931297:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099245440:0@lo:400:kworker.0 00000100:00100000:0.0:1783969324.934202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969324.934298:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099245056 00000100:00100000:1.0:1783969324.934298:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099244928 00000100:00100000:1.0:1783969324.934314:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099244928 00000100:00100000:3.0:1783969324.934335:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099245056 00000100:00100000:3.0:1783969324.934423:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1783969324.934423:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783969324.934431:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099245568:0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.934440:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099245056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.934440:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099244928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.934680:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099245056:12345-0@lo:400:kworker.0 Request processed in 246us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969324.934688:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:3.0:1783969324.934723:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969324.936075:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099244928:12345-0@lo:400:kworker.0 Request processed in 1632us (5034us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969324.936094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.936105:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783969324.936186:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099245568 00000100:00100000:0.0:1783969324.936188:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099245056:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.936198:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099245568 00000100:00100000:1.0:1783969324.936264:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783969324.936273:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099245568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.936358:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099245568:12345-0@lo:400:kworker.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.936365:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783969324.936531:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099245568:0@lo:400:kworker.0 00000100:00080000:3.0:1783969324.936712:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969324.936756:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099244928:0@lo:400:kworker.0 00000100:00100000:2.0:1783969324.947746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969324.947835:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099245184:0@lo:400:kworker.0 00000100:00100000:2.0:1783969324.947906:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969324.947937:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099245696:0@lo:400:kworker.0 00000100:00100000:2.0:1783969324.947959:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969324.948342:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099245184 00000100:00100000:0.0:1783969324.948354:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099245184 00000100:00100000:0.0:1783969324.948471:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099245696 00000100:00100000:0.0:1783969324.948475:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099245696 00000100:00100000:0.0:1783969324.948532:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1783969324.948543:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099245184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969324.948632:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099245184:12345-0@lo:400:kworker.0 Request processed in 91us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969324.948641:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1783969324.948661:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1783969324.948667:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099245696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969324.948698:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099245696:12345-0@lo:400:kworker.0 Request processed in 32us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969324.948704:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1783969324.949722:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099244672 00000100:00100000:3.0:1783969324.949735:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099244672 00000100:00100000:3.0:1783969324.949796:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783969324.949806:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099244672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.949877:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099244672:12345-0@lo:400:kworker.0 Request processed in 72us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969324.949884:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1783969324.950661:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969324.950719:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099244672:0@lo:400:kworker.0 00010000:00080000:2.0:1783969324.950740:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d2d80 x1870627099245184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969324.950751:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099245184:0@lo:400:kworker.0 00010000:00080000:2.0:1783969324.950762:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d1180 x1870627099245696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969324.950792:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099245696:0@lo:400:kworker.0 00000100:00100000:0.0:1783969325.429893:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969325.429926:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099245824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969325.430022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969325.430341:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969325.430353:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099245952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969325.430415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969325.430500:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099245824 00000100:00100000:2.0:1783969325.430511:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099245824 00000100:00100000:2.0:1783969325.430573:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099245952 00000100:00100000:2.0:1783969325.430577:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099245952 00000100:00100000:2.0:1783969325.430597:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783969325.430607:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099245824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969325.430647:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969325.430705:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099245824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969325.430713:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783969325.430733:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783969325.430740:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099245952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969325.430749:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969325.430771:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099245952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969325.430777:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:0.0:1783969325.431156:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea867b3b80 x1870627099245952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969325.431182:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099245952:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1783969325.431219:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf7f9c00 x1870627099245824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969325.431231:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099245824:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783969325.872776:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969326.706014:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783969326.771350:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783969326.877566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969326.877602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969326.877621:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969326.877652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969326.877674:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969326.877702:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073982208 00000100:00100000:1.0:1783969326.877711:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073982208 00000100:00100000:1.0:1783969326.877769:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 387 00000100:00100000:1.0:1783969326.877778:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073982208:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969326.877841:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627073982208:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 64us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969326.877848:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 387 00000100:00100000:1.0:1783969326.877880:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073982464 00000100:00100000:1.0:1783969326.877883:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073982464 00000100:00100000:1.0:1783969326.877916:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073982720 00000100:00100000:1.0:1783969326.877919:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073982720 00000100:00100000:1.0:1783969326.877934:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073982336 00000100:00100000:1.0:1783969326.877936:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073982336 00000100:00100000:1.0:1783969326.877948:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073982592 00000100:00100000:1.0:1783969326.877950:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073982592 00000100:00100000:1.0:1783969326.877964:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 287 00000100:00100000:1.0:1783969326.877969:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073982464:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969326.878000:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073982464:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969326.878008:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 287 00000100:00100000:1.0:1783969326.878019:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 288 00000100:00100000:1.0:1783969326.878025:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073982720:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969326.878046:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073982720:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 21us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969326.878052:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 288 00000100:00100000:1.0:1783969326.878061:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 289 00000100:00100000:1.0:1783969326.878066:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073982336:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969326.878118:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627073982336:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 51us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969326.878129:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 289 00000100:00100000:1.0:1783969326.878141:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 290 00000100:00100000:1.0:1783969326.878146:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073982592:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969326.878169:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627073982592:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969326.878174:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 290 00000100:00080000:1.0:1783969326.878329:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969326.878333:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783969326.899588:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969327.920698:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969328.944569:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969329.017121:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099246080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969329.017203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969329.020444:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099246080 00000100:00100000:3.0:1783969329.020457:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099246080 00000100:00100000:3.0:1783969329.020515:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783969329.020524:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099246080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969329.020563:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783969329.020644:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099246080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (3441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969329.020651:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783969329.020865:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099246080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969329.526486:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969329.526512:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099246208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969329.526581:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969329.526696:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099246208 00000100:00100000:3.0:1783969329.526713:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099246208 00000100:00100000:3.0:1783969329.526772:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783969329.526781:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099246208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969329.526814:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783969329.526862:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099246208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969329.526869:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783969329.526916:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099246208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783969329.974409:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969330.032617:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099246336:0@lo:400:kworker.0 00000100:00100000:1.0:1783969330.032705:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969330.032936:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099246720:0@lo:400:kworker.0 00000100:00100000:2.0:1783969330.032973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969330.033071:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099246336 00000100:00100000:0.0:1783969330.033079:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099246336 00000100:00100000:0.0:1783969330.033139:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1783969330.033149:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099246336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969330.035342:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099246848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969330.035436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.035639:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099246464:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.035677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.035698:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099246976:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.035725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.037966:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099247488:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.038045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.038097:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783969330.038119:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099246592:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.038148:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.038167:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099247104:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.038191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.038207:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099247616:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.038257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.038306:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099246720 00000100:00100000:3.0:1783969330.038313:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099246720 00000100:00100000:3.0:1783969330.038359:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099246464 00000100:00100000:3.0:1783969330.038362:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099246464 00000100:00100000:3.0:1783969330.038394:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099247104 00000100:00100000:3.0:1783969330.038403:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099247104 00000100:00100000:3.0:1783969330.038429:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099247616 00000100:00100000:3.0:1783969330.038432:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099247616 00000100:00100000:3.0:1783969330.038447:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1783969330.038455:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099246720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.038504:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099246720:12345-0@lo:400:kworker.0 Request processed in 50us (5530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969330.038511:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1783969330.038528:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1783969330.038535:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099246464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.038565:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099246464:12345-0@lo:400:kworker.0 Request processed in 31us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969330.038571:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1783969330.038583:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1783969330.038589:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099247104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.038616:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099247104:12345-0@lo:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969330.038621:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1783969330.038632:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1783969330.038638:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099247616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.038662:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099247616:12345-0@lo:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969330.038669:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1783969330.038687:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099246976 00000100:00100000:3.0:1783969330.038691:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099246976 00000100:00100000:3.0:1783969330.038707:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099246592 00000100:00100000:3.0:1783969330.038709:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099246592 00000100:00100000:3.0:1783969330.038729:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783969330.038734:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099246976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041058:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099246976:12345-0@lo:400:kworker.0 Request processed in 2314us (5323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969330.041072:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783969330.041166:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783969330.041186:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099246592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041272:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099246592:12345-0@lo:400:kworker.0 Request processed in 95us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969330.041278:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1783969330.041326:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969330.041367:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099246592:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041398:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099247104:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041412:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099247616:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041424:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099246464:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041436:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099246976:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041480:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099247232:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.041546:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099247744:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.041595:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099246720:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041611:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783969330.041619:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099247360:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041657:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.041679:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099247872:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.041700:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969330.041724:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099247488 00000100:00100000:3.0:1783969330.041730:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099247488 00000100:00100000:2.0:1783969330.042442:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099247360 00000100:00100000:2.0:1783969330.042448:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099247360 00000100:00100000:3.0:1783969330.042580:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099247872 00000100:00100000:3.0:1783969330.042584:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099247872 00000100:00100000:0.0:1783969330.042652:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099246336:12345-0@lo:400:kworker.0 Request processed in 9502us (9944us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969330.042661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1783969330.044020:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783969330.044033:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099247488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.044119:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099247488:12345-0@lo:400:kworker.0 Request processed in 77us (6062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969330.044127:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783969330.044143:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783969330.044150:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099247872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.044179:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099247872:12345-0@lo:400:kworker.0 Request processed in 30us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969330.044185:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783969330.044207:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969330.044221:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099248000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969330.044266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783969330.044317:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969330.044323:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783969330.044350:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98362aa00 x1870627099247488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969330.044363:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099247488:0@lo:400:kworker.0 00000100:00100000:3.0:1783969330.044416:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099247872:0@lo:400:kworker.0 00000100:00100000:0.0:1783969330.044596:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099246848 00000100:00100000:0.0:1783969330.044602:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099246848 00000100:00100000:0.0:1783969330.044645:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099248000 00000100:00100000:0.0:1783969330.044648:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099248000 00000100:00100000:0.0:1783969330.044662:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783969330.044669:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099246848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969330.044690:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969330.044727:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099246848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (9291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969330.044733:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783969330.044758:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783969330.044764:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099248000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969330.044774:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969330.044821:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099248000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969330.044828:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783969330.045436:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099248000:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783969330.045460:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969330.045627:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099247232 00000100:00100000:0.0:1783969330.045632:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099247232 00000100:00100000:0.0:1783969330.045668:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099247744 00000100:00100000:0.0:1783969330.045680:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099247744 00000100:00100000:0.0:1783969330.045705:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1783969330.045712:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099247232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969330.045773:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099247232:12345-0@lo:400:kworker.0 Request processed in 61us (4257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969330.045909:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1783969330.045924:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1783969330.045931:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099247744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969330.045964:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099247744:12345-0@lo:400:kworker.0 Request processed in 34us (4394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969330.045970:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:3.0:1783969330.046026:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783969330.046049:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983629180 x1870627099247232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969330.046060:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099247232:0@lo:400:kworker.0 00010000:00080000:3.0:1783969330.046071:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab7211f80 x1870627099247744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969330.046079:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099247744:0@lo:400:kworker.0 00000100:00100000:2.0:1783969330.046628:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783969330.046637:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099247360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969330.046693:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099247360:12345-0@lo:400:kworker.0 Request processed in 57us (5035us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969330.046700:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1783969330.047352:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98362bb80 x1870627099247360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969330.047365:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099247360:0@lo:400:kworker.0 00000100:00100000:1.0:1783969330.047721:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099246336:0@lo:400:kworker.0 00000100:00100000:1.0:1783969330.047891:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099246848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969330.548527:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099248128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969330.548604:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969330.548674:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099248128 00000100:00100000:0.0:1783969330.548682:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099248128 00000100:00100000:0.0:1783969330.548726:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783969330.548735:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099248128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969330.548765:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969330.548810:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099248128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969330.548817:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:0.0:1783969330.548863:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d2d80 x1870627099248128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969330.548896:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099248128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969330.548997:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969330.549006:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099248256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969330.549036:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969330.549063:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099248256 00000100:00100000:1.0:1783969330.549067:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099248256 00000100:00100000:1.0:1783969330.549092:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783969330.549105:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099248256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969330.549118:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969330.549150:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099248256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969330.549157:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:1.0:1783969330.549184:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9836dc700 x1870627099248256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969330.549197:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099248256:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783969330.992611:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969331.989417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969331.989448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969331.989468:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969331.989484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969331.989518:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969331.989545:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073983104 00000100:00100000:1.0:1783969331.989555:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073983104 00000100:00100000:1.0:1783969331.989608:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073983360 00000100:00100000:1.0:1783969331.989610:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073983360 00000100:00100000:1.0:1783969331.989623:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073982976 00000100:00100000:1.0:1783969331.989625:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073982976 00000100:00100000:1.0:1783969331.989634:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073983232 00000100:00100000:1.0:1783969331.989636:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073983232 00000100:00100000:1.0:1783969331.989650:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 297 00000100:00100000:1.0:1783969331.989659:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073983104:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969331.989732:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073983104:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 74us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969331.989739:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 297 00000100:00100000:2.0:1783969331.989917:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073982848 00000100:00100000:2.0:1783969331.989921:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073982848 00000100:00100000:2.0:1783969331.989953:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 389 00000100:00100000:2.0:1783969331.989959:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2394:x1870627073982848:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969331.989986:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2394:x1870627073982848:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969331.989992:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 389 00000100:00100000:2.0:1783969331.990029:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 298 00000100:00100000:2.0:1783969331.990035:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073983360:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969331.990055:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073983360:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 21us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969331.990061:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 298 00000100:00100000:2.0:1783969331.990073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 299 00000100:00100000:2.0:1783969331.990089:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073982976:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969331.990126:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2394:x1870627073982976:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 36us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969331.990132:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 299 00000100:00100000:2.0:1783969331.990142:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 300 00000100:00100000:2.0:1783969331.990148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073983232:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969331.990165:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073983232:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 18us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969331.990175:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 300 00000100:00080000:1.0:1783969331.990299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969331.990308:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783969332.026192:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783969332.781610:0:14080:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:02:09 (1783969329) 00010000:00010000:3.0:1783969333.042764:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969334.064759:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969334.128709:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969334.128735:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099248384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969334.128809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969334.129150:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099248384 00000100:00100000:0.0:1783969334.129158:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099248384 00000100:00100000:0.0:1783969334.129226:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783969334.129236:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099248384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969334.129582:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783969334.129650:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099248384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 415us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969334.129657:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783969334.129776:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099248384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969334.641427:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099248512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969334.641509:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969334.641734:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099248512 00000100:00100000:3.0:1783969334.641752:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099248512 00000100:00100000:3.0:1783969334.641806:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783969334.641815:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099248512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969334.641846:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783969334.641897:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099248512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969334.641904:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783969334.642067:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099248512:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783969335.089242:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969335.116551:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969335.116685:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073983488 00000100:00100000:0.0:1783969335.116697:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073983488 00000100:00100000:0.0:1783969335.116783:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1783969335.116793:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:11086:x1870627073983488:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969335.116812:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969335.116836:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9dc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037f3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969335.116924:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9dcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969335.116941:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969335.116967:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969335.117019:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783969335.117023:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969335.117060:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969335.117086:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9dc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037f3 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969335.117104:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9dcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037f3 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969335.117113:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea8dcb3400) 00010000:00010000:0.0:1783969335.117116:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969335.117120:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf200, rc 0) 00000100:00100000:0.0:1783969335.117188:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:11086:x1870627073983488:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 396us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969335.117195:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00080000:1.0:1783969335.117677:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969335.131511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969335.131633:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073983616 00000100:00100000:3.0:1783969335.131644:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073983616 00000100:00100000:3.0:1783969335.131714:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:3.0:1783969335.131725:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:11087:x1870627073983616:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969335.131745:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969335.131767:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9dd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563037fa expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.131828:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.131842:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.131868:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.131885:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.131893:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.131899:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.131958:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797800/0xea31253a47cb9deb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.131966:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797800/0xea31253a47cb9deb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.131991:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797800/0xea31253a47cb9deb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969335.132031:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783969335.132035:0:9027:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969335.133009:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797800/0xea31253a47cb9deb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133028:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133034:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133042:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133049:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969335.133053:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133060:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133075:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea8dcb3400) 00010000:00010000:3.0:1783969335.133078:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969335.133083:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133090:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9ddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133120:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133127:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133133:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133139:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969335.133142:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133149:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133169:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93ea911e6c00) 00010000:00010000:3.0:1783969335.133172:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969335.133175:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133181:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9de4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133222:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9dd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037fa expref: 8 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.133237:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797800/0xea31253a47cb9deb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037fa expref: 7 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.134519:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ea911e6500) 00010000:00010000:3.0:1783969335.134522:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969335.134525:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797800, rc 0) 00000100:00100000:3.0:1783969335.134611:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+7:11087:x1870627073983616:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2884us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969335.134620:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:1.0:1783969335.146454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969335.146562:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073983744 00000100:00100000:0.0:1783969335.146573:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073983744 00000100:00100000:0.0:1783969335.146637:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1783969335.146648:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:11087:x1870627073983744:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783969335.146732:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:11087:x1870627073983744:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969335.146740:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1783969335.151741:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969335.151831:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073984000 00000100:00100000:3.0:1783969335.151843:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073984000 00000100:00100000:3.0:1783969335.151924:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:3.0:1783969335.151935:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:11087:x1870627073984000:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969335.151958:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969335.151983:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9df2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303801 expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152058:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152075:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152085:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152099:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152106:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152127:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152246:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796e00/0xea31253a47cb9e07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152255:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796e00/0xea31253a47cb9e07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152261:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796e00/0xea31253a47cb9e07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969335.152270:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1783969335.152369:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152376:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152457:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152464:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969335.152468:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152475:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152487:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ea911e6500) 00010000:00010000:3.0:1783969335.152490:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969335.152503:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152510:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9df9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152523:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152529:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152535:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152540:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969335.152543:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152549:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152557:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93ea911e6c00) 00010000:00010000:3.0:1783969335.152559:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969335.152561:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152566:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e00 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152921:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9df2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303801 expref: 10 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152949:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796e00/0xea31253a47cb9e07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303801 expref: 9 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969335.152956:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:3.0:1783969335.152958:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969335.152960:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796e00, rc 0) 00000100:00100000:3.0:1783969335.153029:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+9:11087:x1870627073984000:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1095us (1297us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783969335.153038:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1783969335.153536:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099248896:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.153592:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969335.153646:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099249408:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.153684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969335.153712:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099249920:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.153734:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969335.153758:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783969335.153764:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099248768:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.153785:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969335.153801:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099249280:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.153819:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969335.153838:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099249792:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.153983:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969335.154010:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099249408 00000100:00100000:1.0:1783969335.154016:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099249408 00000100:00100000:1.0:1783969335.154053:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099249920 00000100:00100000:1.0:1783969335.154057:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099249920 00000100:00100000:1.0:1783969335.154070:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099248768 00000100:00100000:1.0:1783969335.154072:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099248768 00000100:00100000:1.0:1783969335.154094:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099249280 00000100:00100000:1.0:1783969335.154097:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099249280 00000100:00100000:1.0:1783969335.154109:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099249792 00000100:00100000:1.0:1783969335.154111:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099249792 00000100:00100000:1.0:1783969335.154125:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1783969335.154132:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099249408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.154189:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099249408:12345-0@lo:400:kworker.0 Request processed in 57us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969335.154195:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1783969335.154208:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1783969335.154214:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099249920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.154241:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099249920:12345-0@lo:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969335.154247:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1783969335.154258:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1783969335.154264:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099248768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.154287:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099248768:12345-0@lo:400:kworker.0 Request processed in 24us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969335.154292:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1783969335.154302:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1783969335.154307:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099249280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.154521:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099248640:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.154561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969335.154585:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099249152:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.154611:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969335.154630:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099249664:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.154667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969335.154687:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099250176:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.154708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969335.154727:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783969335.154734:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099249024:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.154762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969335.154774:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099249536:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.154794:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969335.154810:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099250048:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.154830:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969335.154869:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099249664 00000100:00100000:2.0:1783969335.154873:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099249664 00000100:00100000:2.0:1783969335.154898:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099250176 00000100:00100000:2.0:1783969335.154900:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099250176 00000100:00100000:2.0:1783969335.154910:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099249536 00000100:00100000:2.0:1783969335.154912:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099249536 00000100:00100000:2.0:1783969335.154922:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099250048 00000100:00100000:2.0:1783969335.154924:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099250048 00000100:00100000:2.0:1783969335.154935:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783969335.154940:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099249664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.154984:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099249664:12345-0@lo:400:kworker.0 Request processed in 43us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969335.154990:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783969335.155003:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969335.155009:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099250176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.155034:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099250176:12345-0@lo:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969335.155041:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969335.155051:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783969335.155057:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099249536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.155081:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099249536:12345-0@lo:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969335.155087:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783969335.155097:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783969335.155102:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099250048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.155125:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099250048:12345-0@lo:400:kworker.0 Request processed in 23us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969335.155130:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783969335.155167:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099248896 00000100:00100000:2.0:1783969335.155171:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099248896 00000100:00100000:2.0:1783969335.155189:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099249152 00000100:00100000:2.0:1783969335.155191:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099249152 00000100:00100000:2.0:1783969335.155203:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783969335.155209:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099248896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.155243:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099248896:12345-0@lo:400:kworker.0 Request processed in 33us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969335.155257:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783969335.155270:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783969335.155276:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099249152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.155307:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099249152:12345-0@lo:400:kworker.0 Request processed in 31us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969335.155313:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783969335.155791:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099249024 00000100:00100000:0.0:1783969335.155796:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099249024 00000100:00100000:0.0:1783969335.155820:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1783969335.155827:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099249792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969335.155878:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099249792:12345-0@lo:400:kworker.0 Request processed in 52us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969335.155884:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1783969335.155896:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1783969335.155902:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099249024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969335.155927:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099249024:12345-0@lo:400:kworker.0 Request processed in 26us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969335.155932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1783969335.155950:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099248640 00000100:00100000:0.0:1783969335.155954:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099248640 00000100:00100000:1.0:1783969335.156149:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099249280:12345-0@lo:400:kworker.0 Request processed in 1841us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969335.156168:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:1.0:1783969335.156190:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969335.156196:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969335.156199:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969335.156211:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969335.156426:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099250304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969335.156459:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969335.156489:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969335.156494:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099250432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969335.156514:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969335.156539:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099250304 00000100:00100000:1.0:1783969335.156542:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099250304 00000100:00100000:1.0:1783969335.156565:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099250432 00000100:00100000:1.0:1783969335.156567:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099250432 00000100:00100000:1.0:1783969335.156578:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783969335.156584:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099250304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969335.156604:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969335.156636:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099250304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969335.156642:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783969335.156652:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783969335.156658:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099250432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969335.156666:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969335.156684:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099250432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 27us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969335.156690:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783969335.156733:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099250432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969335.156745:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099250304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969335.156773:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099248768:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.156783:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099249280:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.156802:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099249792:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.156813:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099248896:0@lo:400:kworker.0 00010000:00080000:1.0:1783969335.156824:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983c75c00 x1870627099249408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969335.156834:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099249408:0@lo:400:kworker.0 00010000:00080000:1.0:1783969335.156843:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983c74700 x1870627099249920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969335.156851:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099249920:0@lo:400:kworker.0 00000100:00100000:1.0:1783969335.161780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969335.161848:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073984128 00000100:00100000:1.0:1783969335.161874:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073984128 00000100:00100000:1.0:1783969335.161930:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1783969335.161941:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:11087:x1870627073984128:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783969335.162057:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:11087:x1870627073984128:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 118us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969335.162064:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1783969335.162483:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1783969335.162494:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099248640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969335.162541:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099248640:12345-0@lo:400:kworker.0 Request processed in 50us (7980us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969335.162548:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1783969335.165210:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969335.165290:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073984256 00000100:00100000:3.0:1783969335.165299:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073984256 00000100:00100000:3.0:1783969335.165376:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:3.0:1783969335.165414:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:11087:x1870627073984256:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1783969335.166054:0:7749:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 596us 00000100:00080000:0.0:1783969335.169252:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969335.169673:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099249024:0@lo:400:kworker.0 00010000:00080000:2.0:1783969335.169820:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983c76300 x1870627099249536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969335.169838:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099249536:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.169857:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099250048:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.169870:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099248640:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.169883:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099249152:0@lo:400:kworker.0 00010000:00080000:2.0:1783969335.169895:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983c76a00 x1870627099249664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969335.169903:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099249664:0@lo:400:kworker.0 00000100:00100000:2.0:1783969335.169915:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099250176:0@lo:400:kworker.0 00000100:00100000:0.0:1783969335.188067:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:11087:x1870627073984256:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 22647us (22858us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969335.188081:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1783969335.664713:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099250560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969335.664813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969335.665111:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969335.665120:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099250688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969335.665170:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969335.665207:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099250560 00000100:00100000:2.0:1783969335.665217:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099250560 00000100:00100000:2.0:1783969335.665273:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099250688 00000100:00100000:2.0:1783969335.665276:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099250688 00000100:00100000:2.0:1783969335.665296:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783969335.665305:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099250560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969335.665581:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969335.665645:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099250560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 339us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969335.665653:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783969335.665675:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783969335.665682:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099250688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969335.665693:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969335.665718:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099250688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969335.665724:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:2.0:1783969335.665771:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea867b2680 x1870627099250688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969335.665794:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099250688:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1783969335.665807:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea85f95180 x1870627099250560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969335.665817:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099250560:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1783969335.921851:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783969335.990944:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783969336.114418:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783969336.945065:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783969337.009322:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783969337.100500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.100627:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073984384 00000100:00100000:2.0:1783969337.100641:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073984384 00000100:00100000:2.0:1783969337.100840:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 391 00000100:00100000:2.0:1783969337.100853:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2393:x1870627073984384:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969337.101003:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2393:x1870627073984384:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 151us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969337.101012:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 391 00000100:00100000:2.0:1783969337.101080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969337.101171:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073984512 00000100:00100000:3.0:1783969337.101176:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073984512 00000100:00100000:3.0:1783969337.101226:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 307 00000100:00100000:3.0:1783969337.101234:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2394:x1870627073984512:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969337.101270:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2394:x1870627073984512:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969337.101277:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 307 00000100:00100000:2.0:1783969337.101314:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00080000:0.0:1783969337.101328:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969337.101356:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.101413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969337.101685:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073984768 00000100:00100000:3.0:1783969337.101701:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073984768 00000100:00100000:1.0:1783969337.101796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073984640 00000100:00100000:1.0:1783969337.101801:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073984640 00000100:00100000:1.0:1783969337.101832:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073984896 00000100:00100000:1.0:1783969337.101835:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073984896 00000100:00100000:1.0:1783969337.101858:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 308 00000100:00100000:1.0:1783969337.101866:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073984640:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969337.101919:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073984640:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 53us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969337.101926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 308 00000100:00100000:1.0:1783969337.101941:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 309 00000100:00080000:0.0:1783969337.102015:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969337.102019:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969337.102543:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073984896:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969337.102587:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627073984896:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 50us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969337.107306:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 309 00000100:00100000:1.0:1783969337.107364:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 310 00000100:00100000:1.0:1783969337.107433:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073984768:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969337.107559:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2394:x1870627073984768:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 184us (6244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969337.107566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 310 00010000:00010000:0.0:1783969337.137360:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969337.658932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969337.659011:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073985024 00000100:00100000:0.0:1783969337.659022:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073985024 00000100:00100000:0.0:1783969337.659088:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1783969337.659098:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+9:11129:x1870627073985024:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969337.659130:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969337.659152:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cb9e15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303808 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659219:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659234:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659246:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659261:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659268:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659274:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659318:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659326:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659344:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659350:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969337.659354:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659362:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659375:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea8dcb3400) 00010000:00010000:0.0:1783969337.659405:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969337.659411:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659417:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659429:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659435:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659441:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659446:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdee00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969337.659449:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659465:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659473:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ea98408d00) 00010000:00010000:0.0:1783969337.659476:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969337.659479:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659485:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cb9e23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659516:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cb9e15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303808 expref: 10 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659526:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea8dcb3400) 00010000:00010000:0.0:1783969337.659529:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969337.659532:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cb9e15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303808 expref: 10 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.659541:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde400, rc 0) 00000100:00100000:0.0:1783969337.659597:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+9:11129:x1870627073985024:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 500us (674us total) trans 0 rc 301/301 00000100:00100000:0.0:1783969337.659605:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1783969337.669930:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969337.670102:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073985280 00000100:00100000:3.0:1783969337.670113:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073985280 00000100:00100000:3.0:1783969337.670186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:3.0:1783969337.670197:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+9:11129:x1870627073985280:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:3.0:1783969337.670261:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969337.670299:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9dcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037f3 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.670322:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea8dcb3400) 00010000:00010000:3.0:1783969337.670333:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969337.670440:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.670454:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.670464:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.670476:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.670483:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.670490:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671259:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671292:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671301:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969337.671318:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000335434fc reply state 00000000c93399ca transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671329:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671336:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:3.0:1783969337.671338:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969337.671342:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783969337.671348:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783969337.671355:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671362:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671369:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671374:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969337.671747:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671759:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671782:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea911e6c00) 00010000:00010000:3.0:1783969337.671784:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969337.671788:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671794:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9e2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969337.671812:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000335434fc reply state 00000000c93399ca transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671820:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.671826:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ea911e6e00) 00010000:00010000:3.0:1783969337.671829:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969337.671831:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783969337.672123:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+10:11129:x1870627073985280:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 1915us (2190us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783969337.672133:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:0.0:1783969337.764502:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.764616:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073985408 00000100:00100000:2.0:1783969337.764625:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073985408 00000100:00100000:2.0:1783969337.764685:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:2.0:1783969337.764695:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+10:11138:x1870627073985408:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:2.0:1783969337.764720:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969337.764744:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9e3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630380f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.764817:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9e46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.764830:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.764842:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969337.764906:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783969337.764910:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969337.764947:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.764990:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9e3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630380f expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.765010:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9e46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630380f expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.765021:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:2.0:1783969337.765024:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969337.765028:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a0a00, rc 0) 00000100:00100000:2.0:1783969337.765081:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+11:11138:x1870627073985408:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 388us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969337.765089:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1783969337.820848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969337.820945:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073985536 00000100:00100000:0.0:1783969337.820955:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073985536 00000100:00100000:0.0:1783969337.821028:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1783969337.821061:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+11:11144:x1870627073985536:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969337.821083:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969337.821106:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303816 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821182:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821196:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821207:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821216:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821223:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821229:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821318:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9e62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821326:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9e62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821333:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9e62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969337.821416:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783969337.821420:0:13769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969337.821458:0:13769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9e62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821469:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821476:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821482:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821487:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdec00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969337.821491:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821498:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821509:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:0.0:1783969337.821511:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969337.821515:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821521:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9e54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821532:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821545:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821550:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821555:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969337.821558:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821563:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821569:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ea911e6e00) 00010000:00010000:0.0:1783969337.821572:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969337.821574:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821579:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9e5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821601:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cb9e4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303816 expref: 13 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821615:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9e62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303816 expref: 12 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969337.821622:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969337.821624:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783969337.821631:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf000, rc 0) 00000100:00100000:0.0:1783969337.821688:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+12:11144:x1870627073985536:12345-192.168.201.34@tcp:101:bash.0 Request processed in 629us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969337.821695:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1783969337.828145:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.828231:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073985792 00000100:00100000:2.0:1783969337.828243:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073985792 00000100:00100000:2.0:1783969337.828307:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:2.0:1783969337.828317:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+12:11144:x1870627073985792:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1783969337.828341:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969337.828365:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9e69 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630381d expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.828520:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.828554:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.828566:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.828582:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.828588:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.828594:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783969337.828943:0:9027:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1783969337.829101:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829123:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829132:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829165:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829172:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829179:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829194:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a1a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969337.829199:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829206:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829219:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969337.829223:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969337.829227:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829233:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9e70 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969337.829249:0:9027:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae65f52a reply state 0000000061d39254 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829262:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829268:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982170a00) 00010000:00010000:2.0:1783969337.829270:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969337.829273:0:9027:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783969337.829303:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9e69 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630381d expref: 15 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829317:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630381d expref: 14 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.829336:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969337.829339:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969337.829341:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad8000, rc 0) 00000100:00100000:2.0:1783969337.829430:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+15:11144:x1870627073985792:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1113us (1296us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1783969337.829438:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1783969337.833666:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.833983:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073985920 00000100:00100000:2.0:1783969337.833993:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073985920 00000100:00100000:2.0:1783969337.834057:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:2.0:1783969337.834065:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1870627073985920:12345-192.168.201.34@tcp:8:bash.0 00010000:00080000:2.0:1783969337.834102:0:8437:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:2.0:1783969337.834144:0:8437:0:(genops.c:1406:class_connect()) connect: client c481ab09-d97e-4adb-b42e-68f98b038d20, cookie 0xea31253a47cb9e8c 00002000:00100000:2.0:1783969337.834158:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c481ab09-d97e-4adb-b42e-68f98b038d20/ffff93eabf7bf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969337.834178:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783969337.834261:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783969337.834291:0:8437:0:(import.c:65:import_set_state_nolock()) ffff93eabf7ba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969337.834372:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2390:x1870627073985920:12345-192.168.201.34@tcp:8:bash.0 Request processed in 305us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969337.834418:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:1.0:1783969337.837199:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.837277:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073986048 00000100:00100000:2.0:1783969337.837287:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073986048 00000100:00100000:2.0:1783969337.837358:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1783969337.837367:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:0:x1870627073986048:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1783969337.837409:0:9974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969337.837444:0:9974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303824 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969337.837468:0:9974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969337.837486:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1783969337.837492:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969337.837501:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303824 expref: 7 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.837524:0:9974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303824 expref: 7 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.837538:0:9974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9e00, rc 0) 00000100:00100000:2.0:1783969337.837584:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:0:x1870627073986048:12345-192.168.201.34@tcp:101:bash.0 Request processed in 219us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969337.837591:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00080000:0.0:1783969337.837659:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969337.842600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.843080:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073986176 00000100:00100000:2.0:1783969337.843090:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073986176 00000100:00100000:2.0:1783969337.843211:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1783969337.843223:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:11144:x1870627073986176:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1783969337.843241:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969337.843261:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630382b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.843295:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303824 expref: 8 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.843321:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969337.843325:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969337.843331:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.843423:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303824 expref: 8 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.843436:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303824 expref: 8 pid: 9974 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969337.843450:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1870627099250816:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969337.843538:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969337.850839:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1870627099250816:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969337.850882:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.850904:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9200, rc 0) 00000100:00100000:2.0:1783969337.856910:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+8:11144:x1870627073986176:12345-192.168.201.34@tcp:101:bash.0 Request processed in 13674us (14303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969337.856924:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:1.0:1783969337.857537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.859809:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073986304 00000100:00100000:2.0:1783969337.859824:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073986304 00010000:00010000:2.0:1783969337.859875:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303824 expref: 8 pid: 9974 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969337.859942:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1783969337.859953:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627073986304:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969337.859979:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969337.860001:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303824 expref: 8 pid: 9974 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.860167:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303824 expref: 8 pid: 9974 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.860210:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f45e9a1/0xea31253a47cb9e93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303824 expref: 8 pid: 9974 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.860441:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969337.860447:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969337.860458:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.860468:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969337.860510:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969337.860525:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1870627099250944:192.168.201.34@tcp:105: 00000100:00100000:2.0:1783969337.860619:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969337.868148:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1870627099250944:192.168.201.34@tcp:105: 00010000:00010000:2.0:1783969337.868183:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969337.868258:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627073986304:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 8305us (10721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969337.868270:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:0.0:1783969337.871099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.873216:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073986560 00000100:00100000:2.0:1783969337.873231:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073986560 00000100:00100000:1.0:1783969337.873449:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1783969337.873462:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+15:11144:x1870627073986560:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1783969337.873808:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11144:x1870627073986560:12345-192.168.201.34@tcp:35:bash.0 Request processed in 347us (2718us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783969337.873816:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1783969337.975897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969337.979541:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073986816 00000100:00100000:3.0:1783969337.979557:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073986816 00000100:00100000:3.0:1783969337.979643:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1783969337.979653:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11154:x1870627073986816:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969337.979680:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969337.979712:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9ea1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303832 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969337.979814:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783969337.979923:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9ea1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303832 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.979936:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:3.0:1783969337.979939:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969337.979944:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9ea1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303832 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969337.979956:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796400, rc 0) 00000100:00100000:3.0:1783969337.980026:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+17:11154:x1870627073986816:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 373us (4139us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1783969337.980033:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1783969337.982528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969337.985233:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073987072 00000100:00100000:2.0:1783969337.985248:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073987072 00000100:00100000:2.0:1783969337.985328:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1783969337.985340:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+17:11154:x1870627073987072:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1783969337.985723:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11154:x1870627073987072:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 384us (3220us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783969337.985731:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1783969338.089622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969338.089742:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073987200 00000100:00100000:0.0:1783969338.089754:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073987200 00000100:00100000:0.0:1783969338.089827:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:0.0:1783969338.089838:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11160:x1870627073987200:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969338.089860:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969338.089881:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9eaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303839 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.089949:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9eb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.089964:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.089978:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969338.090021:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783969338.090025:0:13769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969338.090060:0:13769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.090086:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cb9eaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303839 expref: 20 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.090130:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303839 expref: 19 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.090139:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969338.090142:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969338.090145:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde600, rc 0) 00000100:00100000:0.0:1783969338.090526:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11160:x1870627073987200:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 687us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969338.090534:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:0.0:1783969338.098075:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969338.098203:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073987456 00000100:00100000:2.0:1783969338.098213:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073987456 00000100:00100000:2.0:1783969338.098274:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1783969338.098285:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11160:x1870627073987456:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969338.098312:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969338.098339:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9ebd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303840 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.098486:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9ec4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.098501:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.098525:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969338.098538:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783969338.098643:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9ebd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303840 expref: 22 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.098660:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303840 expref: 21 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.098682:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969338.098685:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969338.098688:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad8800, rc 0) 00000100:00100000:2.0:1783969338.098761:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+21:11160:x1870627073987456:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 478us (695us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783969338.098770:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:3.0:1783969338.101471:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969338.101547:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073987584 00000100:00100000:0.0:1783969338.101556:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073987584 00000100:00100000:0.0:1783969338.101614:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1783969338.101624:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+21:2392:x1870627073987584:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969338.101640:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969338.101662:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9ec4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303840 expref: 21 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.101679:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969338.101683:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969338.101737:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+20:2392:x1870627073987584:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 115us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969338.101744:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1783969338.102810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969338.102877:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073987840 00000100:00100000:3.0:1783969338.102883:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073987840 00000100:00100000:3.0:1783969338.102927:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:3.0:1783969338.102935:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11160:x1870627073987840:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969338.102957:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969338.102975:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9ed2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303847 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.103236:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9ed9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.103252:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.103264:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969338.103292:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783969338.103558:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9ed2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303847 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.103577:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303847 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.103586:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969338.103589:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969338.103592:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797a00, rc 0) 00000100:00100000:3.0:1783969338.103681:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11160:x1870627073987840:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 745us (877us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783969338.103689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1783969338.119987:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969338.120099:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073987968 00000100:00100000:0.0:1783969338.120117:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073987968 00000100:00100000:0.0:1783969338.120195:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:0.0:1783969338.120463:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627073987968:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:0.0:1783969338.120513:0:9974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.120534:0:9974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.120543:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783969338.120547:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969338.120552:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.120588:0:9974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.120602:0:9974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 7 pid: 8437 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969338.120616:0:9974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9974:1870627099251072:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969338.120703:0:9974:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea983ff300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969338.125874:0:9974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9974:1870627099251072:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969338.125909:0:9974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969338.126012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969338.129003:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073988096 00000100:00100000:3.0:1783969338.129019:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073988096 00002000:00100000:3.0:1783969338.129083:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff93ea85f95c00 x1870627073988096/t0(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:234/0 lens 504/0 e 0 to 0 dl 1783969349 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969338.129095:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93ea85f95c00 with x1870627073988096 ext(0->12) 00010000:00010000:3.0:1783969338.129105:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 8 pid: 8437 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.129133:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 8 pid: 8437 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969338.129142:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ea85f95c00 00000100:00100000:3.0:1783969338.129297:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1783969338.129321:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2392:x1870627073988096:12345-192.168.201.34@tcp:4:lfs.0 00000001:00100000:2.0:1783969338.133493:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000100:00100000:3.0:1783969338.135134:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2392:x1870627073988096:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 5800us (9108us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783969338.135151:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:3.0:1783969338.135166:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff93ea85f95c00 x1870627073988096/t4294967300(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:234/0 lens 504/448 e 0 to 0 dl 1783969349 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969338.135823:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93ea85f95c00 with x1870627073988096 ext(0->12) 00010000:00010000:3.0:1783969338.135839:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 9 pid: 8437 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.135858:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 9 pid: 8437 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969338.135866:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ea85f95c00 00000100:00100000:1.0:1783969338.145502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969338.145790:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073988224 00000100:00100000:3.0:1783969338.145801:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073988224 00010000:00010000:3.0:1783969338.145840:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 9 pid: 8437 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969338.145886:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:3.0:1783969338.145896:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2391:x1870627073988224:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969338.145910:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783969338.145929:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783969338.145932:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1783969336 00002000:00010000:3.0:1783969338.145935:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1783969337 00002000:00010000:3.0:1783969338.145950:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1783969336 00002000:00010000:3.0:1783969338.145952:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783969338.145960:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 9 pid: 8437 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.145975:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 9 pid: 8437 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.146007:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba99a624/0xea31253a47cb9e9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630382b expref: 9 pid: 8437 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.146025:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969338.146030:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969338.146037:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.146059:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.146504:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969338.146577:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627073988224:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 680us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969338.146586:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00010000:00010000:0.0:1783969338.148921:0:9974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.148957:0:9974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.148988:0:9974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.148997:0:9974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.149006:0:9974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.149013:0:9974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdec00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969338.149018:0:9974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.149027:0:9974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.149327:0:9974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.149337:0:9974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cb9ee7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969338.149491:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627073987968:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 29028us (29508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969338.149502:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:1.0:1783969338.155157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969338.155496:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073988480 00000100:00100000:2.0:1783969338.155507:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073988480 00000100:00100000:2.0:1783969338.155574:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1783969338.155585:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11160:x1870627073988480:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:2.0:1783969338.155660:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303847 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969338.155907:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1783969338.155967:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783969338.156714:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1783969338.156759:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.156778:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630381d expref: 26 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.156787:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.156822:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630381d expref: 26 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.156837:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630381d expref: 26 pid: 9027 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969338.156852:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1870627099251200:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969338.156950:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea865d93c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783969338.166716:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969338.167062:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1870627099251200:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969338.167092:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969338.167587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969338.167826:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073988608 00000100:00100000:0.0:1783969338.167833:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073988608 00010000:00010000:0.0:1783969338.167871:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630381d expref: 27 pid: 9027 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969338.167914:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:0.0:1783969338.167925:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+27:2391:x1870627073988608:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969338.167943:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969338.167950:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630381d expref: 27 pid: 9027 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.167962:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630381d expref: 27 pid: 9027 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.167985:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9e7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630381d expref: 27 pid: 9027 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.168000:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969338.168006:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.168015:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.168040:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969338.168140:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969338.168212:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+26:2391:x1870627073988608:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 287us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969338.168220:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00010000:00010000:2.0:1783969338.174322:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.174342:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969338.174600:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1783969338.174845:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1783969338.174956:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099251328:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783969338.175028:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969338.175499:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969338.177883:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099251328 00000100:00100000:3.0:1783969338.177899:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099251328 00000100:00100000:2.0:1783969338.178082:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783969338.178095:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1870627099251328:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783969338.178271:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1870627099251328:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 180us (3242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969338.178280:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783969338.178586:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099251328:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783969338.178792:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1783969338.178871:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836fca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099251456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783969338.178912:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969338.178935:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969338.179092:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099251456 00000100:00100000:2.0:1783969338.179097:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099251456 00000100:00100000:2.0:1783969338.179143:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783969338.179151:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1870627099251456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783969338.179502:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6524:x1870627099251456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 350us (587us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783969338.179510:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783969338.179601:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836fca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099251456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783969338.179644:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1783969338.179678:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.179688:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.179695:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.179701:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969338.179705:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.179712:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.179729:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969338.179732:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783969338.179736:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.179742:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9eee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969338.179835:0:6524:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783969338.179911:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1783969338.179924:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400307541897ns, next at 401307539518ns, rc = 0 00000001:00080000:3.0:1783969338.179933:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1783969338.179962:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969338.179965:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969338.179973:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9ed9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303847 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969338.180089:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+29:11160:x1870627073988480:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 24505us (24943us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1783969338.180098:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000020:00080000:3.0:1783969338.180102:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1783969338.183172:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969338.191143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969338.191510:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073988736 00000100:00100000:2.0:1783969338.191520:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073988736 00000100:00100000:2.0:1783969338.191589:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:2.0:1783969338.191601:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+29:11160:x1870627073988736:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969338.191630:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969338.191656:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9ef5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630384e expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.191720:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630384e expref: 30 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.191736:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630384e expref: 30 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.191756:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969338.191771:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969338.191776:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a0c00, rc 0) 00000100:00100000:2.0:1783969338.191843:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+30:11160:x1870627073988736:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 245us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969338.191851:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:2.0:1783969338.208038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969338.208326:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073988992 00000100:00100000:3.0:1783969338.208335:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073988992 00000100:00100000:3.0:1783969338.208422:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1783969338.208434:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+30:11160:x1870627073988992:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1783969338.208690:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+31:11160:x1870627073988992:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 258us (661us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1783969338.208699:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1783969338.352508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969338.352606:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073989248 00000100:00100000:2.0:1783969338.352623:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073989248 00000100:00100000:2.0:1783969338.352714:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:2.0:1783969338.352727:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+31:11170:x1870627073989248:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969338.352756:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969338.352779:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303855 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969338.352890:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783969338.352995:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9efc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303855 expref: 33 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.353022:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:2.0:1783969338.353025:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969338.353030:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303855 expref: 33 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.353044:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a1a00, rc 0) 00000100:00100000:2.0:1783969338.353125:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+32:11170:x1870627073989248:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 402us (632us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1783969338.353133:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:1.0:1783969338.357604:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969338.362143:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073989376 00000100:00100000:2.0:1783969338.362164:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073989376 00000100:00100000:2.0:1783969338.362476:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:2.0:1783969338.362490:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+32:11170:x1870627073989376:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1783969338.362619:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362643:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362659:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362677:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362685:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362693:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362797:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362806:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362814:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969338.362879:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362918:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362926:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362933:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362939:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a1a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969338.362944:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362953:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362968:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969338.362982:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969338.362988:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.362995:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1a00/0xea31253a47cb9f0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363014:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363020:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363027:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363039:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969338.363042:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363048:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363056:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982170a00) 00010000:00010000:2.0:1783969338.363059:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969338.363062:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363068:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363077:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363084:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363089:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363094:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad9200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969338.363097:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363113:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363133:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969338.363135:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969338.363139:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.363145:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969338.363279:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+32:11170:x1870627073989376:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 791us (5701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969338.363289:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:0.0:1783969338.376984:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969338.377339:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073989632 00000100:00100000:3.0:1783969338.377353:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073989632 00000100:00100000:3.0:1783969338.377448:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1783969338.377461:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+32:11170:x1870627073989632:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969338.383120:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+33:11170:x1870627073989632:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 4744us (5240us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1783969338.383146:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1783969338.458911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969338.459055:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073989888 00000100:00100000:2.0:1783969338.459069:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073989888 00000100:00100000:2.0:1783969338.459179:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1783969338.459192:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+33:11173:x1870627073989888:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969338.459227:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969338.459256:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630385c expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.459356:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.459374:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.459436:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.459449:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.459475:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.459482:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.459615:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.459624:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.459632:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969338.459644:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783969338.460004:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460014:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460022:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460028:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969338.460032:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460040:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460066:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969338.460069:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969338.460073:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460080:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460096:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460112:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460118:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460123:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969338.460126:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460132:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460139:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982170a00) 00010000:00010000:2.0:1783969338.460142:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969338.460145:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460161:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460221:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630385c expref: 36 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460237:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630385c expref: 35 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.460246:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969338.460248:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969338.460250:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9e00, rc 0) 00000100:00100000:2.0:1783969338.460329:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+35:11173:x1870627073989888:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1139us (1433us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1783969338.460338:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1783969338.474050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969338.476787:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073990016 00000100:00100000:3.0:1783969338.476814:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073990016 00000100:00100000:3.0:1783969338.476920:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1783969338.476954:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+35:11173:x1870627073990016:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:3.0:1783969338.477266:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.477290:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.477305:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.477355:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.477364:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.477372:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.477808:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969338.477816:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.477827:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.477842:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:3.0:1783969338.477845:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969338.477851:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.477858:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969338.478138:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+35:11173:x1870627073990016:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 1183us (4101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969338.478148:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:1.0:1783969338.490055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969338.491136:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073990272 00000100:00100000:2.0:1783969338.491155:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073990272 00000100:00100000:2.0:1783969338.491233:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1783969338.491246:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+35:11173:x1870627073990272:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1783969338.491635:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+36:11173:x1870627073990272:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 390us (2079us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1783969338.491644:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1783969338.884527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969338.890935:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073990528 00000100:00100000:3.0:1783969338.890956:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073990528 00000100:00100000:3.0:1783969338.891063:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1783969338.891077:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+36:11204:x1870627073990528:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:3.0:1783969338.891313:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969338.891343:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303863 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.891521:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.891540:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.891556:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969338.891568:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783969338.891725:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303863 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.891749:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303863 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969338.891759:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:3.0:1783969338.891783:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969338.891788:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796400, rc 0) 00000100:00100000:3.0:1783969338.891882:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+38:11204:x1870627073990528:12345-192.168.201.34@tcp:101:cat.0 Request processed in 808us (7370us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783969338.891891:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:1.0:1783969338.904721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969338.905228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969338.905359:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073990912 00000100:00100000:0.0:1783969338.905374:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073990912 00000100:00100000:0.0:1783969338.905478:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1783969338.905491:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+38:11204:x1870627073990912:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:0.0:1783969338.905881:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+39:11204:x1870627073990912:12345-192.168.201.34@tcp:35:cat.0 Request processed in 391us (654us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1783969338.905891:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1783969338.906883:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073990656 00000100:00100000:2.0:1783969338.906897:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073990656 00000100:00100000:2.0:1783969338.907030:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:2.0:1783969338.907041:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+39:2391:x1870627073990656:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969338.907059:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969338.907092:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303863 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969338.907144:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969338.907151:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969338.907276:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+38:2391:x1870627073990656:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 236us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969338.907285:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1783969339.012500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969339.012746:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073991168 00000100:00100000:2.0:1783969339.012761:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073991168 00000100:00100000:2.0:1783969339.012864:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:2.0:1783969339.012878:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+38:11210:x1870627073991168:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:2.0:1783969339.012913:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969339.012917:0:7749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783969339.012952:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cb9eb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303839 expref: 38 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783969339.013265:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783969339.013376:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969339.013453:0:7749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969339.013475:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f5e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630386a expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.013902:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.013923:0:7749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630385c expref: 38 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.013933:0:7749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.014083:0:7749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630385c expref: 38 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.014230:0:7749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630385c expref: 38 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969339.014251:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099251584:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969339.014756:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969339.022426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969339.022563:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073991296 00000100:00100000:0.0:1783969339.022580:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073991296 00010000:00010000:0.0:1783969339.022644:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630385c expref: 39 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969339.022719:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:0.0:1783969339.022732:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+39:2391:x1870627073991296:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969339.022783:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969339.022794:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630385c expref: 39 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.022810:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630385c expref: 39 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.022840:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969339.022845:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.022856:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.022865:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.022889:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969339.023160:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+39:2391:x1870627073991296:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 429us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969339.023170:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00010000:00010000:2.0:1783969339.030470:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630385c expref: 38 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969339.030501:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099251584:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969339.030531:0:7749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.030542:0:7749:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.030549:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969339.030572:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783969339.030889:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f5e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630386a expref: 39 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.030905:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630386a expref: 38 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.030934:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969339.030938:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969339.030946:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad8800, rc 0) 00000100:00100000:2.0:1783969339.031039:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+38:11210:x1870627073991168:12345-192.168.201.34@tcp:101:dd.0 Request processed in 18164us (18559us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1783969339.031048:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1783969339.044587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969339.046563:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073991424 00000100:00100000:2.0:1783969339.046586:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073991424 00000100:00100000:2.0:1783969339.046704:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:2.0:1783969339.046717:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+38:11210:x1870627073991424:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:2.0:1783969339.046765:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969339.046796:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303871 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.046840:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.046856:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.046869:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.047033:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9f73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303871 expref: 40 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.047058:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303871 expref: 39 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.047077:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969339.047081:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969339.047085:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9e00, rc 0) 00000100:00100000:2.0:1783969339.047459:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+39:11210:x1870627073991424:12345-192.168.201.34@tcp:101:dd.0 Request processed in 665us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969339.047470:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1783969339.051518:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969339.053532:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073991680 00000100:00100000:2.0:1783969339.053555:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073991680 00000100:00100000:2.0:1783969339.053650:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:2.0:1783969339.053664:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+39:11210:x1870627073991680:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:2.0:1783969339.054025:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.054049:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.054065:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969339.054156:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1783969339.054185:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b62a6b10 reply state 000000003f4f70b9 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.054201:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.054211:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969339.054214:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969339.054226:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969339.054366:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+42:11210:x1870627073991680:12345-192.168.201.34@tcp:36:dd.0 Request processed in 703us (2863us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1783969339.054375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000020:00080000:2.0:1783969339.054420:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783969339.188327:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969339.248891:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969339.248925:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099251712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969339.249025:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969339.249452:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099251712 00000100:00100000:3.0:1783969339.249464:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099251712 00000100:00100000:3.0:1783969339.249539:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783969339.249552:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099251712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969339.249613:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1783969339.249687:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099251712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969339.249695:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783969339.249957:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099251712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969339.523488:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969339.523601:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073991808 00000100:00100000:3.0:1783969339.523616:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073991808 00000100:00100000:3.0:1783969339.523699:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:3.0:1783969339.523712:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+42:11224:x1870627073991808:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:3.0:1783969339.523748:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969339.523775:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303878 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.523869:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.523888:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.523901:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.523925:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.523934:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.523941:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.524065:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.524078:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630386a expref: 43 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.524099:0:13769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.524148:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630386a expref: 43 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969339.524244:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630386a expref: 43 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969339.524264:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099251840:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969339.524443:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab92d9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969339.527415:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099251840:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969339.527455:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969339.530016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969339.530159:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073992064 00000100:00100000:0.0:1783969339.530231:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073992064 00000100:00100000:0.0:1783969339.530313:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1783969339.530326:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+44:6163:x1870627073992064:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783969339.530793:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+45:6163:x1870627073992064:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 467us (790us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1783969339.530803:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1783969339.543732:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969339.547650:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073992192 00000100:00100000:2.0:1783969339.547674:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073992192 00010000:00010000:2.0:1783969339.547752:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630386a expref: 45 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969339.547820:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1783969339.547833:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab211b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+45:2391:x1870627073992192:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969339.547857:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969339.547867:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630386a expref: 45 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.547884:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630386a expref: 45 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.547920:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9f65 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630386a expref: 45 pid: 7749 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.547942:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969339.547948:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.547982:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.547991:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.548041:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969339.548141:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab211b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+44:2391:x1870627073992192:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 310us (4424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969339.548151:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00010000:00010000:0.0:1783969339.549233:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549249:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969339.549321:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783969339.549326:0:13769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969339.549429:0:13769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549448:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549460:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549467:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549475:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549481:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969339.549486:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549493:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549508:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969339.549511:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969339.549516:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549538:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cb9f8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549554:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549559:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549955:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549964:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969339.549968:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549974:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549985:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982170a00) 00010000:00010000:0.0:1783969339.549988:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969339.549991:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.549997:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cb9f96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.550046:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cb9f88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303878 expref: 44 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.550078:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303878 expref: 43 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969339.550095:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969339.550098:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969339.550101:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52000, rc 0) 00000100:00100000:0.0:1783969339.550332:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+43:11224:x1870627073991808:12345-192.168.201.34@tcp:101:stat.0 Request processed in 26619us (26858us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969339.550342:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:1.0:1783969339.677159:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969339.678925:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073992448 00000100:00100000:2.0:1783969339.678945:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073992448 00000100:00100000:2.0:1783969339.679048:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:2.0:1783969339.679059:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+43:11230:x1870627073992448:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:2.0:1783969339.679157:0:9027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969339.679376:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cb9f9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303878 expref: 43 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.679499:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969339.679506:0:9027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969339.683532:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.683565:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.683580:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969339.683724:0:9027:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1783969339.683787:0:9027:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006c73be57 reply state 000000005fb32993 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.683802:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.683810:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969339.683813:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969339.683817:0:9027:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969339.683981:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+45:11230:x1870627073992448:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 4917us (6840us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1783969339.683991:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000020:00080000:2.0:1783969339.683997:0:9027:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783969339.760706:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969339.762423:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099251968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969339.762539:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969339.762892:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099251968 00000100:00100000:1.0:1783969339.762903:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099251968 00000100:00100000:1.0:1783969339.763016:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783969339.763030:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099251968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969339.763093:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969339.763178:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099251968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969339.763187:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783969339.763288:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099251968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969339.862004:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969339.863268:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073992576 00000100:00100000:1.0:1783969339.863289:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073992576 00000100:00100000:1.0:1783969339.863440:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1783969339.863454:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+45:11244:x1870627073992576:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:1.0:1783969339.863487:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969339.863516:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600800/0xea31253a47cb9fab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630387f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863607:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863624:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863637:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863651:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863681:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863688:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863816:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863826:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863834:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969339.863893:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1783969339.863899:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969339.863932:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863945:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863955:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863961:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863969:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.863987:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969339.863992:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864001:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864016:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:1.0:1783969339.864020:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969339.864027:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864034:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cb9fb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864070:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864077:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864095:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864102:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969339.864266:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864274:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864292:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982170a00) 00010000:00010000:1.0:1783969339.864295:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969339.864298:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864303:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cb9fb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864339:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600800/0xea31253a47cb9fab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630387f expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864357:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630387f expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969339.864365:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:1.0:1783969339.864367:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969339.864370:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2177600, rc 0) 00000100:00100000:1.0:1783969339.864502:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+46:11244:x1870627073992576:12345-192.168.201.34@tcp:101:stat.0 Request processed in 1051us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969339.864511:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1783969339.966538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969339.966663:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073992832 00000100:00100000:2.0:1783969339.966678:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073992832 00000100:00100000:2.0:1783969339.966766:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:2.0:1783969339.966781:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+46:11254:x1870627073992832:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969339.966815:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969339.966849:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9fc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303886 expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969339.967010:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783969339.967174:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9fc7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303886 expref: 48 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.967378:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:2.0:1783969339.967485:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969339.967493:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9200/0xea31253a47cb9fc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303886 expref: 48 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969339.967513:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e981ad9200, rc 0) 00000100:00100000:2.0:1783969339.967592:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+47:11254:x1870627073992832:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 815us (1068us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1783969339.967601:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:0.0:1783969339.976268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969339.976515:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073993088 00000100:00100000:1.0:1783969339.976528:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073993088 00000100:00100000:1.0:1783969339.976608:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1783969339.976621:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+47:11254:x1870627073993088:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1783969339.976962:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+48:11254:x1870627073993088:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 342us (707us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1783969339.976993:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1783969340.097667:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969340.097916:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073993344 00000100:00100000:3.0:1783969340.097931:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073993344 00000100:00100000:3.0:1783969340.098085:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:3.0:1783969340.098101:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+48:11260:x1870627073993344:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1783969340.098153:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969340.098257:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fd5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630388d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.098580:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.098602:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630387f expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.098613:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.098660:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630387f expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.098677:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630387f expref: 49 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969340.098718:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1870627099252096:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969340.098866:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab92d9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969340.114806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969340.114946:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1870627099252096:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969340.114986:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969340.115086:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073993472 00000100:00100000:0.0:1783969340.115096:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073993472 00010000:00010000:0.0:1783969340.115161:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630387f expref: 50 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969340.115438:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1783969340.115451:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+50:2392:x1870627073993472:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969340.115472:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969340.115481:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630387f expref: 50 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.115496:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630387f expref: 50 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.115532:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cb9fc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630387f expref: 50 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.115596:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969340.115603:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.115616:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.115626:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.115660:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969340.115742:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+49:2392:x1870627073993472:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 291us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969340.115762:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00010000:00010000:3.0:1783969340.116158:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.116167:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969340.116203:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1783969340.116440:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630388d expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.116464:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630388d expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.116473:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:3.0:1783969340.116476:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783969340.116479:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53000, rc 0) 00000100:00100000:3.0:1783969340.116530:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+49:11260:x1870627073993344:12345-192.168.201.34@tcp:101:bash.0 Request processed in 18434us (18879us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1783969340.116538:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:2.0:1783969340.131487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969340.131667:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073993728 00000100:00100000:3.0:1783969340.131700:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073993728 00000100:00100000:3.0:1783969340.131790:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:3.0:1783969340.131804:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+49:11260:x1870627073993728:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:3.0:1783969340.132323:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.132349:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.132364:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969340.132580:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1783969340.132608:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003758b4c7 reply state 0000000097583900 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.132625:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.132634:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:3.0:1783969340.132638:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969340.132643:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969340.132968:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+52:11260:x1870627073993728:12345-192.168.201.34@tcp:36:bash.0 Request processed in 1164us (1495us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1783969340.132979:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000020:00080000:3.0:1783969340.132995:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783969340.152641:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969340.152773:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073993856 00000100:00100000:0.0:1783969340.152786:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073993856 00000100:00100000:0.0:1783969340.152906:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:0.0:1783969340.152919:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+52:11260:x1870627073993856:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969340.152956:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969340.152997:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cb9ff1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303894 expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.153137:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.153156:0:7749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630388d expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.153198:0:7749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.153244:0:7749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630388d expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.153262:0:7749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630388d expref: 53 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969340.153279:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099252224:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969340.153646:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea983ff840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969340.165446:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099252224:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969340.165504:0:7749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969340.165844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969340.170283:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073993984 00000100:00100000:3.0:1783969340.170311:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073993984 00010000:00010000:3.0:1783969340.170425:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630388d expref: 54 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969340.170530:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1783969340.170542:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+54:2391:x1870627073993984:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969340.170564:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969340.170573:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630388d expref: 54 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.170590:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630388d expref: 54 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.170618:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cb9fdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630388d expref: 54 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.170639:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:3.0:1783969340.170646:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.171140:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.171154:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.171198:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969340.171440:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+53:2391:x1870627073993984:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 839us (5537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.171451:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00010000:00010000:0.0:1783969340.172331:0:7749:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.172348:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969340.172461:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783969340.172466:0:7749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969340.172766:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.172819:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cb9ff1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303894 expref: 53 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.172867:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303894 expref: 52 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.172877:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969340.172880:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969340.172884:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf200, rc 0) 00000100:00100000:0.0:1783969340.172957:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+52:11260:x1870627073993856:12345-192.168.201.34@tcp:101:bash.0 Request processed in 20040us (20331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969340.172966:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:2.0:1783969340.180461:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969340.185965:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073994240 00000100:00100000:1.0:1783969340.185998:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073994240 00000100:00100000:1.0:1783969340.186105:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:1.0:1783969340.186118:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+52:11260:x1870627073994240:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1783969340.186880:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+53:11260:x1870627073994240:12345-192.168.201.34@tcp:35:bash.0 Request processed in 759us (6429us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1783969340.186892:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000001:00080000:3.0:1783969340.205744:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000004:00080000:3.0:1783969340.205840:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1783969340.205874:0:6500:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93e9824b2300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1783969340.205881:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab7523200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93e9824b2900 00000020:00080000:3.0:1783969340.205884:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab7523900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93e982733000 00000100:00100000:1.0:1783969340.208979:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969340.209022:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099252352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783969340.209133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1783969340.209504:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1783969340.209754:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1783969340.210118:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969340.210449:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099252352 00000100:00100000:1.0:1783969340.210462:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099252352 00000100:00100000:1.0:1783969340.210629:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969340.210644:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099252352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783969340.210687:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1783969340.210735:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a553638, atime: 0x6a553639, ctime: 0x6a553638, blocks: 0x8 00010000:00010000:1.0:1783969340.210747:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.210770:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1783969340.210775:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969340.210783:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.210823:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.210834:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.210842:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.210858:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783969340.211072:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969340.211091:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.211101:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969340.211106:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.211115:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.211137:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.211154:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052647a54/0xea31253a47cb9fff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.211189:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969340.211191:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969340.211193:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783969340.212342:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969340.212899:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1870627099252352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2252us (3760us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783969340.212915:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1783969340.216675:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216700:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216708:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216715:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969340.216721:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216731:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216755:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ea911e6e00) 00010000:00010000:0.0:1783969340.216759:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969340.216765:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216800:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cb9e31 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216837:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216843:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216849:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216854:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969340.216858:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216864:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216873:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969340.216876:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969340.216879:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216885:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cb9e38 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216905:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216912:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216925:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216931:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969340.216934:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216941:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216950:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982170a00) 00010000:00010000:0.0:1783969340.216952:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969340.216955:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216961:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0000/0xea31253a47cb9e77 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216985:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216992:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.216997:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217003:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969340.217006:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217023:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217032:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969340.217034:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969340.217037:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217042:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8000/0xea31253a47cb9f81 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217054:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217059:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217065:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217069:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969340.217072:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217087:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217095:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969340.217097:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969340.217099:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217116:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad8800/0xea31253a47cb9fa4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217128:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217135:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217140:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217146:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969340.217149:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217155:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217165:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969340.217167:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969340.217170:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.217176:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cb9fea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783969340.217838:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93eabf92b800/2, rc 0, transno 4294967302 00000100:00100000:2.0:1783969340.217854:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099252352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783969340.272788:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099252480:0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.272912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969340.273234:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099252608:0@lo:400:kworker.0 00000100:00100000:3.0:1783969340.273289:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969340.273335:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099253120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969340.273364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969340.273420:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969340.273427:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099252736:0@lo:400:kworker.0 00000100:00100000:3.0:1783969340.273457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969340.273497:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099253120 00000100:00100000:3.0:1783969340.273506:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099253120 00000100:00100000:3.0:1783969340.273578:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783969340.273590:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099253120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783969340.273632:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969340.273686:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099253120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.273694:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783969340.273754:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099253120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969340.273780:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099252736 00000100:00100000:3.0:1783969340.273784:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099252736 00000100:00100000:3.0:1783969340.273812:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783969340.273818:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099252736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969340.273854:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099252736:12345-0@lo:400:kworker.0 Request processed in 37us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.273860:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783969340.273884:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099252736:0@lo:400:kworker.0 00000100:00100000:3.0:1783969340.273902:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099252608 00000100:00100000:3.0:1783969340.273906:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099252608 00000100:00100000:3.0:1783969340.273934:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783969340.273940:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099252608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969340.273988:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099252608:12345-0@lo:400:kworker.0 Request processed in 48us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.273995:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783969340.274018:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099252608:0@lo:400:kworker.0 00000100:00080000:3.0:1783969340.274061:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969340.274518:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099252992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969340.274572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969340.274609:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969340.274616:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099252864:0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.274645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969340.274700:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099252480 00000100:00100000:0.0:1783969340.274706:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099252480 00000100:00100000:0.0:1783969340.274741:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1783969340.274748:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099252480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.274787:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099252480:12345-0@lo:400:kworker.0 Request processed in 40us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969340.274793:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1783969340.274847:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099252480:0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.274895:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099252864 00000100:00100000:0.0:1783969340.274899:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099252864 00000100:00100000:0.0:1783969340.274924:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1783969340.274930:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099252864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.274964:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099252864:12345-0@lo:400:kworker.0 Request processed in 34us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969340.274970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1783969340.274997:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099252864:0@lo:400:kworker.0 00000100:00100000:3.0:1783969340.276296:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099252992 00000100:00100000:3.0:1783969340.276313:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099252992 00000100:00100000:3.0:1783969340.276434:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783969340.276445:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099252992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969340.276476:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969340.276560:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099252992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.276568:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783969340.276643:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099252992:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783969340.276787:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969340.276970:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099253376:0@lo:400:kworker.0 00000100:00100000:1.0:1783969340.277018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969340.277045:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099253888:0@lo:400:kworker.0 00000100:00100000:1.0:1783969340.277068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969340.277102:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969340.277107:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099253504:0@lo:400:kworker.0 00000100:00100000:1.0:1783969340.277130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969340.277341:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099253248:0@lo:400:kworker.0 00000100:00100000:1.0:1783969340.277424:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099253376 00000100:00100000:1.0:1783969340.277431:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099253376 00000100:00100000:1.0:1783969340.277478:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099253888 00000100:00100000:1.0:1783969340.277481:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099253888 00000100:00100000:1.0:1783969340.277500:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099253504 00000100:00100000:1.0:1783969340.277520:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099253504 00000100:00100000:1.0:1783969340.277548:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1783969340.277555:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099253376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969340.277704:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099253632:0@lo:400:kworker.0 00000100:00080000:3.0:1783969340.277763:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969340.277767:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969340.277903:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1783969340.277913:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099253888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.278141:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969340.278409:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099253760:0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.278440:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969340.278488:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099253248 00000100:00100000:0.0:1783969340.278494:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099253248 00000100:00100000:0.0:1783969340.278529:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783969340.278536:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099253248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.278581:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099253248:12345-0@lo:400:kworker.0 Request processed in 43us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969340.278588:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783969340.278640:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099253248:0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.278686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099253760 00000100:00100000:0.0:1783969340.278689:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099253760 00000100:00100000:0.0:1783969340.278720:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1783969340.278726:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099253504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.278760:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099253504:12345-0@lo:400:kworker.0 Request processed in 34us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969340.278766:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1783969340.278779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1783969340.278785:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099253760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969340.278815:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099253760:12345-0@lo:400:kworker.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969340.278821:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:0.0:1783969340.278835:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969340.278853:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099253760:0@lo:400:kworker.0 00010000:00080000:0.0:1783969340.278905:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf92b480 x1870627099253504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969340.278918:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099253504:0@lo:400:kworker.0 00000100:00100000:1.0:1783969340.279070:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099253376:12345-0@lo:400:kworker.0 Request processed in 1514us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969340.279089:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1783969340.279260:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969340.279417:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099253632 00000100:00100000:1.0:1783969340.279422:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099253632 00000100:00100000:1.0:1783969340.279470:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783969340.279477:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099253632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969340.279519:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099253632:12345-0@lo:400:kworker.0 Request processed in 42us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969340.279525:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783969340.279597:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099253376:0@lo:400:kworker.0 00000100:00080000:2.0:1783969340.279654:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969340.279675:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099253632:0@lo:400:kworker.0 00000100:00100000:3.0:1783969340.279927:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099253888:12345-0@lo:400:kworker.0 Request processed in 2015us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.279935:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00080000:0.0:1783969340.280017:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf929880 x1870627099253888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969340.280030:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099253888:0@lo:400:kworker.0 00000100:00100000:2.0:1783969340.303957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969340.304338:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073994496 00000100:00100000:0.0:1783969340.304359:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073994496 00000100:00100000:0.0:1783969340.304723:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:0.0:1783969340.304748:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+12:11270:x1870627073994496:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969340.304785:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969340.304814:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba006 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630389b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969340.304953:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783969340.305579:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba006 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630389b expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.305603:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:0.0:1783969340.305606:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969340.305614:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba006 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630389b expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.305635:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdfa00, rc 0) 00000100:00100000:0.0:1783969340.305724:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+13:11270:x1870627073994496:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 989us (1784us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1783969340.305742:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:0.0:1783969340.309486:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969340.309586:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073994624 00000100:00100000:3.0:1783969340.309600:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073994624 00000100:00100000:3.0:1783969340.309678:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:3.0:1783969340.309691:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+13:11270:x1870627073994624:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:3.0:1783969340.309823:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.309844:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.309858:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.309875:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.309882:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.309889:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310000:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310011:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310018:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969340.310093:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310108:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310124:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310132:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310139:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969340.310143:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310151:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310277:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:3.0:1783969340.310282:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969340.310287:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310295:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba014 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310311:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310318:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310325:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310330:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969340.310339:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310346:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310355:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93ea911e6c00) 00010000:00010000:3.0:1783969340.310359:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969340.310362:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310369:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba01b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310429:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310435:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310441:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310446:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969340.310449:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310455:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310463:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:3.0:1783969340.310465:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969340.310478:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.310484:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba022 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969340.310732:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+13:11270:x1870627073994624:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1041us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.310743:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:1.0:1783969340.325582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969340.336083:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073994880 00000100:00100000:3.0:1783969340.336107:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073994880 00000100:00100000:2.0:1783969340.336415:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1783969340.336429:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+13:11270:x1870627073994880:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969340.337687:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+14:11270:x1870627073994880:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 1250us (12111us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783969340.337704:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1783969340.397617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969340.397779:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073995136 00000100:00100000:1.0:1783969340.397793:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073995136 00000100:00100000:1.0:1783969340.397869:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:1.0:1783969340.397881:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+14:11273:x1870627073995136:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969340.397917:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969340.397946:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba029 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038a2 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.398048:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.398065:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.398091:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.398117:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.398125:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.398132:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.398845:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba03e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.398864:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba03e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.398882:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba03e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969340.398898:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783969340.399017:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399025:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399033:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399039:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969340.399045:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399068:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399094:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:1.0:1783969340.399097:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969340.399103:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399110:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba030 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399148:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399155:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399770:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399776:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969340.399779:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399787:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399797:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982253600) 00010000:00010000:1.0:1783969340.399800:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969340.399804:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399827:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba037 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399911:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba029 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038a2 expref: 17 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399930:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba03e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038a2 expref: 16 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.399937:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:1.0:1783969340.399939:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969340.399942:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2177600, rc 0) 00000100:00100000:1.0:1783969340.400037:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11273:x1870627073995136:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 2156us (2432us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1783969340.400048:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:0.0:1783969340.409133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969340.409202:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969340.409904:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073995264 00000100:00100000:2.0:1783969340.409917:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073995264 00000100:00100000:2.0:1783969340.409993:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:2.0:1783969340.410004:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11273:x1870627073995264:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1783969340.410105:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.410129:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.410150:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.410209:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.410218:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.410225:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.410231:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969340.410236:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.410245:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.410259:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969340.410263:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969340.410296:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.410303:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba04c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969340.410451:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11273:x1870627073995264:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 446us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969340.410460:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:2.0:1783969340.413480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969340.413566:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073995648 00000100:00100000:0.0:1783969340.413579:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073995648 00000100:00100000:0.0:1783969340.413650:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1783969340.413661:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11273:x1870627073995648:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969340.414125:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+17:11273:x1870627073995648:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 463us (659us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1783969340.414136:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1783969340.417566:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073995392 00000100:00100000:1.0:1783969340.417589:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073995392 00000100:00100000:1.0:1783969340.417709:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:1.0:1783969340.417724:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+17:2391:x1870627073995392:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969340.417746:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969340.417784:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba03e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038a2 expref: 17 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969340.417835:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:1.0:1783969340.417842:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969340.417920:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+16:2391:x1870627073995392:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 201us (8717us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969340.417946:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:2.0:1783969340.627368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969340.627502:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073995904 00000100:00100000:0.0:1783969340.627515:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073995904 00000100:00100000:0.0:1783969340.627595:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:0.0:1783969340.627608:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11291:x1870627073995904:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1783969340.627644:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969340.627689:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba053 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.627832:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba05a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.627850:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba05a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.627862:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba05a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969340.627892:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783969340.628034:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba053 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038a9 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.628057:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba05a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038a9 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.628086:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969340.628090:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783969340.628095:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde400, rc 0) 00000100:00100000:0.0:1783969340.628191:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11291:x1870627073995904:12345-192.168.201.34@tcp:101:cat.0 Request processed in 584us (837us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1783969340.628199:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:2.0:1783969340.653872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969340.654062:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073996032 00000100:00100000:3.0:1783969340.654086:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073996032 00000100:00100000:3.0:1783969340.654265:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:3.0:1783969340.654278:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11292:x1870627073996032:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969340.654310:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969340.654336:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038b0 expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.654446:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba06f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.654463:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba06f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.654478:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba06f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969340.654536:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783969340.654540:0:7749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969340.654562:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba06f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.654608:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b0 expref: 20 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.654628:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba06f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b0 expref: 19 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.654639:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:3.0:1783969340.654642:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969340.654645:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53200, rc 0) 00000100:00100000:3.0:1783969340.654913:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11292:x1870627073996032:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 637us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.654923:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:1.0:1783969340.659989:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969340.660098:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073996416 00000100:00100000:0.0:1783969340.660111:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073996416 00000100:00100000:0.0:1783969340.660335:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:0.0:1783969340.660348:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11292:x1870627073996416:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969340.660911:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11292:x1870627073996416:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 563us (934us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1783969340.660922:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1783969340.664052:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969340.664283:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073996544 00000100:00100000:3.0:1783969340.664294:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073996544 00000100:00100000:3.0:1783969340.664371:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1783969340.664405:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11292:x1870627073996544:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:3.0:1783969340.664425:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783969340.664457:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cb9ff8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303894 expref: 20 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.664483:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba05a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038a9 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.664497:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0c00/0xea31253a47cb9ef5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630384e expref: 18 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969340.664531:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:3.0:1783969340.664536:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969340.664599:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+17:11292:x1870627073996544:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 218us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.664607:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1783969340.667546:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969340.667796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073996672 00000100:00100000:2.0:1783969340.667808:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073996672 00000100:00100000:2.0:1783969340.667914:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1783969340.667925:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+17:11292:x1870627073996672:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:2.0:1783969340.668104:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.668126:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969340.668147:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969340.668636:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969340.668962:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1783969340.669064:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1783969340.669424:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+17:11292:x1870627073996672:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 1495us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969340.669437:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:1.0:1783969340.694008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969340.694130:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073996800 00000100:00100000:0.0:1783969340.694145:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073996800 00000100:00100000:0.0:1783969340.694236:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:0.0:1783969340.694248:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+17:11294:x1870627073996800:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969340.694276:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969340.694324:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba07d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.694460:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.694479:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.694493:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.694510:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.694517:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.694523:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.694636:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.694647:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.694654:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969340.696371:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783969340.696400:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969340.696437:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696483:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696495:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696503:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696511:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696518:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdee00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969340.696524:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696534:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696554:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969340.696558:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969340.696564:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696571:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba084 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696592:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696599:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696611:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696617:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969340.696620:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696627:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696637:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93ea98408d00) 00010000:00010000:0.0:1783969340.696639:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969340.696643:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.696649:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba08b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.697005:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba07d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b7 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.697024:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b7 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969340.697032:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969340.697034:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969340.697037:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde600, rc 0) 00000100:00100000:0.0:1783969340.697213:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11294:x1870627073996800:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 2965us (3218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969340.697236:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:0.0:1783969340.786354:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969340.786363:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099254144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969340.786420:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099254016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969340.787295:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969340.788086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969340.789758:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099254144 00000100:00100000:1.0:1783969340.789775:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099254144 00000100:00100000:1.0:1783969340.789860:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099254016 00000100:00100000:1.0:1783969340.789864:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099254016 00000100:00100000:1.0:1783969340.789884:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783969340.789895:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099254144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969340.789939:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969340.790049:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099254144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 155us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969340.790057:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783969340.790086:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783969340.790093:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1870627099254016:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969340.790447:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099254144:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969340.790601:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969340.790657:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1870627099254016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 563us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969340.790665:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783969340.791312:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099254016:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1783969341.040762:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969341.040778:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969341.040829:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783969341.040842:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969341.041046:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836fe300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099254272:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783969341.041508:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969341.052688:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836fe300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099254272:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783969341.053328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.053872:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073996928 00000100:00100000:3.0:1783969341.053883:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073996928 00000100:00100000:3.0:1783969341.053978:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:3.0:1783969341.053990:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11305:x1870627073996928:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783969341.054038:0:13769:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1783969341.054111:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969341.054220:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11305:x1870627073996928:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 231us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.054229:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:3.0:1783969341.060055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.060583:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073997056 00000100:00100000:0.0:1783969341.060598:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073997056 00000100:00100000:0.0:1783969341.060748:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:0.0:1783969341.060764:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11305:x1870627073997056:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783969341.060869:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.060890:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.060906:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064675:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064700:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064714:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064772:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064781:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064789:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969341.064842:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783969341.064847:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969341.064861:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064873:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064879:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064884:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064891:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdfa00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969341.064895:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064901:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064913:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:0.0:1783969341.064921:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969341.064926:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064932:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba099 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064950:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064956:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064961:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064966:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969341.064969:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064974:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064981:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff93ea98408d00) 00010000:00010000:0.0:1783969341.064983:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969341.064986:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.064991:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba0a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.065005:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.065016:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.065022:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.065027:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdee00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969341.065029:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.065035:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.065043:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969341.065046:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969341.065048:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.065054:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969341.065158:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11305:x1870627073997056:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 4395us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969341.065166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:3.0:1783969341.072439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.072520:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073997312 00000100:00100000:0.0:1783969341.072535:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073997312 00000100:00100000:0.0:1783969341.072728:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:0.0:1783969341.072741:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11305:x1870627073997312:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969341.072764:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969341.072799:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba0ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038be expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.072908:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.072923:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.072936:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969341.072947:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783969341.073759:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.073772:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.073780:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.073787:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969341.073791:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.073799:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.073813:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:0.0:1783969341.073816:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969341.073821:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.073842:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.073892:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba0ae lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038be expref: 20 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.073903:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:0.0:1783969341.073906:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969341.073910:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba0ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038be expref: 20 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.073920:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdec00, rc 0) 00000100:00100000:0.0:1783969341.077354:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11305:x1870627073997312:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3557us (3873us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1783969341.077397:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:1.0:1783969341.084162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.084727:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073997440 00000100:00100000:0.0:1783969341.084737:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073997440 00000100:00100000:0.0:1783969341.084786:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:0.0:1783969341.084796:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11305:x1870627073997440:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783969341.084835:0:13769:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783969341.084951:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11305:x1870627073997440:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 156us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969341.084960:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:1.0:1783969341.091771:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969341.091879:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073997696 00000100:00100000:2.0:1783969341.091889:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073997696 00000100:00100000:2.0:1783969341.091952:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:2.0:1783969341.091963:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11305:x1870627073997696:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969341.091993:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969341.091997:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783969341.092024:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba06f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b0 expref: 19 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.092044:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969341.092049:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969341.092073:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038c5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783969341.092524:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1783969341.092967:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba0ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.093040:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.093051:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.093924:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038c5 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.093964:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba0ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038c5 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.093973:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93e982597800) 00010000:00010000:2.0:1783969341.094041:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969341.094045:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dafc00, rc 0) 00000100:00100000:2.0:1783969341.094170:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11305:x1870627073997696:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2208us (2407us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1783969341.094179:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:2.0:1783969341.098422:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.098511:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073997952 00000100:00100000:3.0:1783969341.098520:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073997952 00000100:00100000:3.0:1783969341.098589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:3.0:1783969341.098599:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11305:x1870627073997952:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969341.099029:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969341.099057:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba0ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038c5 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.099091:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93e982597800) 00010000:00010000:3.0:1783969341.099101:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969341.099125:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.099138:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.099158:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.101882:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.101904:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.101916:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102036:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102045:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102053:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102070:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.102092:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102101:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102114:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969341.102117:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969341.102122:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102129:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba0d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102141:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102206:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102213:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102219:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.102222:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102229:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102237:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x674bbfa3 (ffff93e982597400) 00010000:00010000:2.0:1783969341.102240:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969341.102248:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.102255:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba0df lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x674bbfa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.102622:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11305:x1870627073997952:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 4018us (4205us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969341.102632:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:0.0:1783969341.109270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.109320:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073998080 00000100:00100000:0.0:1783969341.109330:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073998080 00000100:00100000:0.0:1783969341.109407:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1783969341.109417:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11305:x1870627073998080:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969341.109436:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969341.109460:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038cc expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.109510:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.109523:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.109535:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.109851:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba0e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038cc expref: 21 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.109871:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038cc expref: 20 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.109881:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:0.0:1783969341.109885:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783969341.109888:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdee00, rc 0) 00000100:00100000:0.0:1783969341.109954:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11305:x1870627073998080:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 538us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969341.109962:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1783969341.118810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.119423:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073998336 00000100:00100000:3.0:1783969341.119434:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073998336 00000100:00100000:3.0:1783969341.119503:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:3.0:1783969341.119514:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11305:x1870627073998336:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969341.119598:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.119629:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.119642:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969341.119813:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1783969341.119822:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403247440779ns, next at 404247438634ns, rc = 0 00000004:00010000:3.0:1783969341.119867:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061ddd479 reply state 00000000c0c2c525 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.119882:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.119890:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:3.0:1783969341.119894:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783969341.119897:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969341.120000:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11305:x1870627073998336:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 487us (1201us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1783969341.120008:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:3.0:1783969341.128313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969341.128419:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073998464 00000100:00100000:1.0:1783969341.128430:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073998464 00000100:00100000:1.0:1783969341.128516:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:1.0:1783969341.128527:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11305:x1870627073998464:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969341.128552:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969341.128573:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038d3 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.128647:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038d3 expref: 23 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.128663:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038d3 expref: 23 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.128683:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:1.0:1783969341.128686:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969341.128690:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2176a00, rc 0) 00000100:00100000:1.0:1783969341.128750:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+23:11305:x1870627073998464:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 225us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969341.128757:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:1.0:1783969341.135316:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.135483:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073998592 00000100:00100000:3.0:1783969341.135494:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073998592 00000100:00100000:3.0:1783969341.135542:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1783969341.135551:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1870627073998592:12345-192.168.201.34@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1783969341.135589:0:8437:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:3.0:1783969341.135796:0:8437:0:(genops.c:1406:class_connect()) connect: client c481ab09-d97e-4adb-b42e-68f98b038d20, cookie 0xea31253a47cba102 00002000:00100000:3.0:1783969341.135809:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c481ab09-d97e-4adb-b42e-68f98b038d20/ffff93e983d1c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783969341.135819:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783969341.135890:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783969341.135915:0:8437:0:(import.c:65:import_set_state_nolock()) ffff93e983d1d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969341.136041:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2390:x1870627073998592:12345-192.168.201.34@tcp:8:lhsmtool_posix.0 Request processed in 489us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.136073:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:1.0:1783969341.155205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969341.155256:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073998720 00000100:00100000:1.0:1783969341.155266:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073998720 00000100:00100000:1.0:1783969341.155339:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1783969341.155351:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:0:x1870627073998720:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783969341.155578:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1783969341.161205:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1783969341.161229:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000100:00100000:1.0:1783969341.161557:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:0:x1870627073998720:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 6199us (6353us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783969341.161580:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:2.0:1783969341.163971:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.164116:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073998976 00000100:00100000:0.0:1783969341.164126:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073998976 00000100:00100000:0.0:1783969341.164239:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1783969341.164249:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+23:11305:x1870627073998976:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783969341.164828:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+24:11305:x1870627073998976:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 577us (863us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1783969341.164838:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1783969341.180366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969341.180488:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073999232 00000100:00100000:2.0:1783969341.180499:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073999232 00000100:00100000:2.0:1783969341.180556:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:2.0:1783969341.180566:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+24:11305:x1870627073999232:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783969341.180681:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+24:11305:x1870627073999232:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 116us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969341.180690:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:0.0:1783969341.187679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.187818:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073999360 00000100:00100000:3.0:1783969341.187829:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073999360 00000100:00100000:3.0:1783969341.187897:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:3.0:1783969341.187909:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+24:11305:x1870627073999360:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969341.187929:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969341.187949:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba109 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038da expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.188047:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.188075:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.188089:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969341.188138:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969341.188172:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.188202:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba109 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038da expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.188222:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba110 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038da expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.188230:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:3.0:1783969341.188240:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783969341.188244:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53400, rc 0) 00000100:00100000:3.0:1783969341.188310:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+25:11305:x1870627073999360:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 404us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.188318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:3.0:1783969341.197037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.197097:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073999488 00000100:00100000:3.0:1783969341.197108:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073999488 00000100:00100000:3.0:1783969341.197163:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:3.0:1783969341.197172:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627073999488:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969341.197190:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969341.197211:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969341.197237:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a55363c, blocks: 0x0 00010000:00010000:3.0:1783969341.197257:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1783969341.197261:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969341.197271:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e1 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.197291:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e1 expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.197303:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53c00, rc 0) 00000100:00100000:3.0:1783969341.197367:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627073999488:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 195us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.197417:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:1.0:1783969341.205984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.213089:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073999744 00000100:00100000:0.0:1783969341.213105:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073999744 00000100:00100000:0.0:1783969341.214155:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:0.0:1783969341.214171:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+25:11305:x1870627073999744:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783969341.214311:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+25:11305:x1870627073999744:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 145us (8349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969341.214319:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:3.0:1783969341.224480:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.224518:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627073999872 00000100:00100000:3.0:1783969341.224528:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627073999872 00000100:00100000:3.0:1783969341.224578:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:3.0:1783969341.224588:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:11305:x1870627073999872:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969341.224606:0:9974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969341.224625:0:9974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038e8 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.224660:0:9974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e1 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.224670:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969341.224675:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969341.224682:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 7 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.224717:0:9974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e1 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.224731:0:9974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e1 expref: 7 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.224746:0:9974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9974:1870627099254400:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969341.224836:0:9974:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969341.228717:0:9974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9974:1870627099254400:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969341.228753:0:9974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 7 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.228777:0:9974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52e00, rc 0) 00000100:00100000:0.0:1783969341.228843:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:11305:x1870627073999872:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 4256us (4374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969341.228853:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00010000:00010000:0.0:1783969341.235311:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969341.244713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.244958:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074000000 00000100:00100000:0.0:1783969341.244968:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074000000 00010000:00010000:0.0:1783969341.245009:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e1 expref: 7 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969341.245082:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:0.0:1783969341.245093:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2392:x1870627074000000:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969341.245111:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969341.245142:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e1 expref: 7 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.245157:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e1 expref: 7 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.245186:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe41f0d0/0xea31253a47cba117 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e1 expref: 7 pid: 8439 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.245202:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969341.245207:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969341.245217:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 6 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.245227:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 6 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.245265:0:7929:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 6 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969341.245290:0:7929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7929:1870627099254528:192.168.201.34@tcp:105: 00000100:00100000:0.0:1783969341.245374:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969341.248524:0:7929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7929:1870627099254528:192.168.201.34@tcp:105: 00010000:00010000:0.0:1783969341.248553:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969341.248617:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074000000:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 3524us (3914us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969341.248629:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1783969341.249441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.250550:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074000128 00000100:00100000:0.0:1783969341.250563:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074000128 00002000:00100000:0.0:1783969341.250620:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff93eab7210700 x1870627074000128/t0(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:237/0 lens 504/0 e 0 to 0 dl 1783969352 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783969341.250631:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab7210700 with x1870627074000128 ext(0->8) 00002000:00010000:0.0:1783969341.250637:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93eab7210700 00000100:00100000:0.0:1783969341.250679:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1783969341.250690:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627074000128:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783969341.251689:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074000128:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 995us (2246us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1783969341.251700:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:0.0:1783969341.251709:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff93eab7210700 x1870627074000128/t4294967303(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:237/0 lens 504/448 e 0 to 0 dl 1783969352 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783969341.251718:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab7210700 with x1870627074000128 ext(0->8) 00002000:00010000:0.0:1783969341.251722:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93eab7210700 00000100:00100000:2.0:1783969341.268298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.268485:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074000256 00000100:00100000:3.0:1783969341.268496:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074000256 00000100:00100000:3.0:1783969341.268559:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:3.0:1783969341.268570:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+25:11305:x1870627074000256:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783969341.270676:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1783969341.270694:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783969341.270738:0:6500:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1783969341.270761:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1783969341.270771:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783969341.271194:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969341.271215:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099254656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783969341.271284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969341.271450:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+15:11305:x1870627074000256:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 2879us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.271461:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:3.0:1783969341.271609:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099254656 00000100:00100000:3.0:1783969341.271616:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099254656 00000100:00100000:3.0:1783969341.271651:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783969341.271659:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099254656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783969341.271785:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783969341.271789:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783969340 00002000:00010000:3.0:1783969341.271791:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783969341.271793:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1783969340 -> 1783969340 00002000:00010000:3.0:1783969341.271795:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783969341.271828:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1870627099254656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 169us (544us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783969341.271835:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1783969341.271876:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ea8e967100/2, rc 0, transno 4294967304 00000100:00100000:3.0:1783969341.271883:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8e967100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099254656:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1783969341.272261:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.272274:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.272282:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.272289:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969341.272294:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.272302:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.272318:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:0.0:1783969341.272321:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783969341.272327:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.272333:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba0f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.279268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.280246:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074000384 00000100:00100000:0.0:1783969341.280258:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074000384 00000100:00100000:0.0:1783969341.280361:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1783969341.280373:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2394:x1870627074000384:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783969341.285506:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1783969341.285519:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1783969341.285689:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2394:x1870627074000384:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 5311us (6422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969341.285702:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:3.0:1783969341.293962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969341.294044:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074000640 00000100:00100000:2.0:1783969341.294053:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074000640 00000100:00100000:2.0:1783969341.294139:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:2.0:1783969341.294165:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+14:11305:x1870627074000640:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783969341.294224:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969341.294252:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba110 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038da expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.294271:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:2.0:1783969341.294276:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969341.294308:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.294322:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.294332:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969341.294500:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040bbf3af reply state 000000000c6ec34c transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.294514:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.294520:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:2.0:1783969341.294523:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969341.294526:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969341.294621:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+15:11305:x1870627074000640:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 457us (668us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1783969341.294629:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:2.0:1783969341.297570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.301119:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074000768 00000100:00100000:3.0:1783969341.301151:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074000768 00000100:00100000:3.0:1783969341.301213:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:3.0:1783969341.301224:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074000768:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783969341.301434:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1783969341.301438:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1783969340 -> 1783969339 00002000:00010000:3.0:1783969341.301440:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783969337 00002000:00010000:3.0:1783969341.301443:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1783969340 -> 1783969339 00002000:00010000:3.0:1783969341.301445:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1783969341.301514:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2392:x1870627074000768:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 292us (3953us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783969341.301523:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1783969341.304896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.304985:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074001024 00000100:00100000:3.0:1783969341.304995:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074001024 00000100:00100000:3.0:1783969341.305067:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1783969341.305079:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+15:11305:x1870627074001024:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783969341.305221:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.305241:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038cc expref: 15 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.305253:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.305306:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038cc expref: 15 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.305322:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038cc expref: 15 pid: 13769 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.305336:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099254784:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969341.305451:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969341.308283:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099254784:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969341.308316:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.312541:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.312582:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074001152 00000100:00100000:3.0:1783969341.312592:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074001152 00010000:00010000:3.0:1783969341.312647:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038cc expref: 16 pid: 13769 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.312685:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1783969341.312695:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+16:2392:x1870627074001152:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969341.312710:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969341.312717:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038cc expref: 16 pid: 13769 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.312730:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038cc expref: 16 pid: 13769 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.312752:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba0ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038cc expref: 16 pid: 13769 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.313738:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:3.0:1783969341.313749:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.313761:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.313769:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.314266:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969341.314332:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+15:2392:x1870627074001152:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 1636us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.314342:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00010000:00010000:2.0:1783969341.316484:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.316501:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.316547:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.316555:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.316561:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.316567:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.316571:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.316577:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.316594:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:2.0:1783969341.316597:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783969341.316601:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.316608:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba12c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.316709:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+14:11305:x1870627074001024:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 11629us (11818us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783969341.316719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1783969341.330700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.330962:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074001280 00000100:00100000:0.0:1783969341.330974:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074001280 00000100:00100000:0.0:1783969341.334136:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1783969341.334165:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074001280:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783969341.334228:0:9974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.334249:0:9974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 7 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.334258:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969341.334263:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969341.334268:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.334304:0:9974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 7 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.334318:0:9974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 7 pid: 9974 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969341.334333:0:9974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9974:1870627099254912:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969341.334448:0:9974:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9834199c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969341.349167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.349716:0:9974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9974:1870627099254912:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969341.349743:0:9974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.350320:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074001408 00000100:00100000:2.0:1783969341.350330:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074001408 00010000:00010000:2.0:1783969341.350372:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 8 pid: 9974 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.350443:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:2.0:1783969341.350453:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab211bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074001408:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969341.350472:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969341.350496:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 8 pid: 9974 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.350509:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 8 pid: 9974 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.350535:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2fa1172/0xea31253a47cba11e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038e8 expref: 8 pid: 9974 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.350552:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969341.350557:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969341.350563:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.350587:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.350613:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969341.350670:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab211bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074001408:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 218us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969341.350678:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00010000:00010000:0.0:1783969341.350846:0:9974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.350867:0:9974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.350887:0:9974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.350896:0:9974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.350903:0:9974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.350911:0:9974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdee00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969341.350916:0:9974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.350923:0:9974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.350935:0:9974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.350942:0:9974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b7f4b23/0xea31253a47cba133 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969341.351005:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627074001280:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 16847us (20316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969341.351015:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:3.0:1783969341.371759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969341.371868:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074001664 00000100:00100000:0.0:1783969341.371878:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074001664 00000100:00100000:0.0:1783969341.371932:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:0.0:1783969341.371942:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+14:11305:x1870627074001664:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783969341.372032:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.372051:0:7749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303871 expref: 14 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.372074:0:7749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.372117:0:7749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303871 expref: 14 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969341.372149:0:7749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303871 expref: 14 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969341.372165:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099255040:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969341.372252:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969341.384734:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.385787:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074001792 00000100:00100000:3.0:1783969341.385801:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074001792 00010000:00010000:3.0:1783969341.385842:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303871 expref: 15 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.385883:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:3.0:1783969341.385893:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+15:2392:x1870627074001792:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969341.385909:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969341.385915:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303871 expref: 15 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.385941:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303871 expref: 15 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.385966:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:3.0:1783969341.385971:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.385981:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.385987:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.386005:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969341.386071:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+15:2392:x1870627074001792:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 179us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.386077:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00010000:00010000:1.0:1783969341.388431:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e981ad9e00/0xea31253a47cb9f7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303871 expref: 14 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969341.388456:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099255040:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969341.388481:0:7749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.388554:0:7749:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.388562:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.388790:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.388804:0:7749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038d3 expref: 14 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.388825:0:7749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.388862:0:7749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038d3 expref: 14 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.388876:0:7749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038d3 expref: 14 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.388891:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099255168:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969341.388974:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9822350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969341.394870:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969341.395076:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074001920 00000100:00100000:2.0:1783969341.395086:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074001920 00010000:00010000:2.0:1783969341.395138:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038d3 expref: 15 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.395194:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:2.0:1783969341.395207:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+15:2391:x1870627074001920:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969341.395224:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969341.395233:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038d3 expref: 15 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.395246:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038d3 expref: 15 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.395277:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:2.0:1783969341.395282:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.395294:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.395311:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.395337:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969341.395433:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+15:2391:x1870627074001920:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 226us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969341.395442:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00010000:00010000:2.0:1783969341.396838:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba0fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038d3 expref: 14 pid: 9027 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.396876:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099255168:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969341.396901:0:7749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.396911:0:7749:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.396917:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969341.397030:0:7749:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1783969341.397287:0:7749:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1783969341.397327:0:7749:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1783969341.397484:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c75880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7749:1870627099255296:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783969341.397550:0:7749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969341.397622:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824cff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969341.401305:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099255296 00000100:00100000:1.0:1783969341.401319:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099255296 00000100:00100000:3.0:1783969341.401463:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783969341.401474:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7749:x1870627099255296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783969341.401609:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7749:x1870627099255296:12345-0@lo:1000:mdt00_003.0 Request processed in 136us (4058us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.401616:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783969341.401659:0:7749:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1783969341.401665:0:7749:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ea8e967100, transno 4294967304 00000100:00100000:3.0:1783969341.401678:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c75880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7749:1870627099255296:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1783969341.401832:0:7749:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1783969341.401901:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7749:1870627099255424:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783969341.401941:0:7749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969341.401959:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969341.402031:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099255424 00000100:00100000:3.0:1783969341.402035:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099255424 00000100:00100000:3.0:1783969341.402079:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783969341.402085:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7749:x1870627099255424:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783969341.402456:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7749:x1870627099255424:12345-0@lo:1000:mdt00_003.0 Request processed in 369us (513us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783969341.402463:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783969341.402948:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7749:1870627099255424:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1783969341.402991:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403009:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403016:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403022:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.403026:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403033:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403049:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:2.0:1783969341.403052:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969341.403067:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403074:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba141 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403101:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403107:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403112:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403116:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafe00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.403135:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403274:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403284:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969341.403286:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969341.403289:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403295:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba076 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403319:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403334:0:7749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b7 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403342:0:7749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403377:0:7749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b7 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.403531:0:7749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b7 expref: 17 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.403544:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099255552:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969341.403629:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824cf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969341.407716:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099255552:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969341.407749:0:7749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.409984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969341.410579:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074002048 00000100:00100000:1.0:1783969341.410588:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074002048 00010000:00010000:1.0:1783969341.410627:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b7 expref: 18 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969341.410660:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1783969341.410682:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+18:2392:x1870627074002048:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969341.410698:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969341.410705:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b7 expref: 18 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.410734:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b7 expref: 18 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.410757:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba092 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038b7 expref: 18 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.410771:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:1.0:1783969341.410776:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.410786:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.410795:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.410823:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969341.410879:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+17:2392:x1870627074002048:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 209us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969341.410886:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00010000:00010000:2.0:1783969341.411433:0:7749:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411443:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411457:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411465:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411472:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411477:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafa00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.411482:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411489:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411499:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969341.411501:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969341.411506:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411512:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba148 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411535:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411541:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411546:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411550:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdee00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.411554:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411559:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411567:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e982170b00) 00010000:00010000:2.0:1783969341.411570:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969341.411572:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.411578:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba13a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.411743:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11305:x1870627074001664:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 39801us (39992us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1783969341.411752:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00000020:00080000:2.0:1783969341.411756:0:7749:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783969341.412896:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969341.412904:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969341.412927:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783969341.412935:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969341.430683:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.430819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074002304 00000100:00100000:3.0:1783969341.430829:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074002304 00000100:00100000:3.0:1783969341.430888:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:3.0:1783969341.430899:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11305:x1870627074002304:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783969341.431198:0:6524:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783969341.431229:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1783969341.431265:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.431281:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.431292:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.431300:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.431306:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.431312:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.431343:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783969341.431458:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11305:x1870627074002304:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 561us (784us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1783969341.431467:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000020:00080000:3.0:1783969341.431472:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783969341.431769:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969341.431776:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.431783:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969341.431794:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.431803:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.431816:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:1.0:1783969341.431819:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783969341.431826:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.431833:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba14f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969341.431846:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969341.431848:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969341.431849:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969341.644178:0:14228:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969341.644187:0:14228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969341.644223:0:14228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783969341.644230:0:14228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969341.782683:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969341.782781:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074002560 00000100:00100000:2.0:1783969341.782793:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074002560 00000100:00100000:2.0:1783969341.782867:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:2.0:1783969341.782878:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+18:11315:x1870627074002560:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969341.782904:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969341.782923:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038ef expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.783023:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba15d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.783035:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba15d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.783044:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba15d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969341.783064:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783969341.783279:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038ef expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.783296:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba15d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038ef expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.783304:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969341.783307:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969341.783311:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83daf400, rc 0) 00000100:00100000:2.0:1783969341.783433:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11315:x1870627074002560:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 557us (759us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1783969341.783441:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:3.0:1783969341.785325:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969341.785502:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074002688 00000100:00100000:2.0:1783969341.785517:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074002688 00000100:00100000:2.0:1783969341.785582:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:2.0:1783969341.785592:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11315:x1870627074002688:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1783969341.785684:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785701:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785712:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785727:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785734:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785741:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785821:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785829:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785835:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969341.785878:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785901:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785908:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785914:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785920:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafc00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.785924:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785930:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785943:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969341.785945:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969341.785949:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785954:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba16b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785966:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785971:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785976:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785987:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daee00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.785990:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.785996:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.786004:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e98216e300) 00010000:00010000:2.0:1783969341.786006:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969341.786009:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.786015:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba172 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.786029:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.786037:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.786042:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.786047:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969341.787873:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.787884:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.787910:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93e98216e600) 00010000:00010000:2.0:1783969341.787913:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969341.787918:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.787925:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf200/0xea31253a47cba179 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.792452:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11315:x1870627074002688:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 6849us (7124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969341.792468:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:0.0:1783969341.866795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.866980:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074002944 00000100:00100000:3.0:1783969341.866991:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074002944 00000100:00100000:3.0:1783969341.867085:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:3.0:1783969341.867095:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+20:11318:x1870627074002944:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969341.867117:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969341.867137:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba180 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038f6 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867218:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867232:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867243:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867258:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867264:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867283:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867426:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867435:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867441:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969341.867451:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783969341.867526:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867534:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867541:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867547:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969341.867552:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867560:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867572:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:3.0:1783969341.867575:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969341.867587:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867593:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba187 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867607:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867614:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867619:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867624:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969341.867627:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867633:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867640:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93ea911e6c00) 00010000:00010000:3.0:1783969341.867642:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969341.867644:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867650:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba18e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867689:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba180 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038f6 expref: 23 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867712:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038f6 expref: 22 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.867719:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:3.0:1783969341.867721:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969341.867723:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52400, rc 0) 00000100:00100000:3.0:1783969341.867792:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11318:x1870627074002944:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 699us (1007us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1783969341.867800:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:2.0:1783969341.875959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.876070:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074003072 00000100:00100000:3.0:1783969341.876083:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074003072 00000100:00100000:3.0:1783969341.876164:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:3.0:1783969341.876175:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11318:x1870627074003072:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:3.0:1783969341.876246:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.876264:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.876278:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.876316:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.876323:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.876345:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.876351:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969341.876356:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.876364:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.876377:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:3.0:1783969341.876429:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969341.876434:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.876441:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.876517:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11318:x1870627074003072:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 343us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.876524:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:1.0:1783969341.879292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.879432:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074003328 00000100:00100000:3.0:1783969341.879442:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074003328 00000100:00100000:3.0:1783969341.879489:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1783969341.879499:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11318:x1870627074003328:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1783969341.879788:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+23:11318:x1870627074003328:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 289us (504us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1783969341.879797:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1783969341.918141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.918235:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074003584 00000100:00100000:3.0:1783969341.918244:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074003584 00000100:00100000:3.0:1783969341.918307:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:3.0:1783969341.918318:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+23:10844:x1870627074003584:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1783969341.918344:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969341.918365:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563038fd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.918512:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.918527:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038f6 expref: 24 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.918537:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.918571:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038f6 expref: 24 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.918584:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038f6 expref: 24 pid: 13769 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969341.918598:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099255680:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969341.918699:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969341.924727:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099255680:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969341.924755:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969341.926357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969341.926699:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074003712 00000100:00100000:2.0:1783969341.926710:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074003712 00010000:00010000:2.0:1783969341.926759:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038f6 expref: 25 pid: 13769 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969341.926810:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:2.0:1783969341.926821:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+25:2392:x1870627074003712:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969341.926841:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969341.926850:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038f6 expref: 25 pid: 13769 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.926863:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038f6 expref: 25 pid: 13769 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.926888:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba195 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038f6 expref: 25 pid: 13769 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.926919:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:2.0:1783969341.926925:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.926934:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.926943:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.926973:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969341.927041:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+24:2392:x1870627074003712:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 221us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969341.927061:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00010000:00010000:3.0:1783969341.927721:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.927734:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969341.927754:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783969341.927910:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038fd expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.927927:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038fd expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.927935:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:3.0:1783969341.927938:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783969341.927940:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52600, rc 0) 00000100:00100000:3.0:1783969341.927985:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+24:10844:x1870627074003584:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9668us (9855us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1783969341.927993:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:1.0:1783969341.934615:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.934761:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074003840 00000100:00100000:3.0:1783969341.934771:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074003840 00000100:00100000:3.0:1783969341.934828:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:3.0:1783969341.934839:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+24:10844:x1870627074003840:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1783969341.934863:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969341.934884:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303904 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.934943:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba1c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.934959:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.934972:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.935106:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba1bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303904 expref: 26 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.935142:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303904 expref: 25 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.935151:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:3.0:1783969341.935154:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783969341.935157:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53a00, rc 0) 00000100:00100000:3.0:1783969341.935482:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+25:10844:x1870627074003840:12345-192.168.201.34@tcp:101:bash.0 Request processed in 642us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.935491:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:2.0:1783969341.949304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.949529:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074004096 00000100:00100000:3.0:1783969341.949540:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074004096 00000100:00100000:3.0:1783969341.949634:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:3.0:1783969341.949645:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+25:10844:x1870627074004096:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:3.0:1783969341.949880:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.949917:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.949928:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969341.949971:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1783969341.949992:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000337ac517 reply state 0000000024ca69e6 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.950005:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.950012:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:3.0:1783969341.950015:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969341.950018:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783969341.950066:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1783969341.950190:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+29:10844:x1870627074004096:12345-192.168.201.34@tcp:36:bash.0 Request processed in 546us (894us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1783969341.950198:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00000020:00080000:3.0:1783969341.950203:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783969341.954344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969341.954661:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074004224 00000100:00100000:2.0:1783969341.954672:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074004224 00000100:00100000:2.0:1783969341.954762:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:2.0:1783969341.954773:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+29:10844:x1870627074004224:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1783969341.954797:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969341.954816:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba1d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630390b expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.954878:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630390b expref: 30 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.954894:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630390b expref: 30 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969341.954932:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:2.0:1783969341.954936:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969341.954940:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dafc00, rc 0) 00000100:00100000:2.0:1783969341.955038:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+30:10844:x1870627074004224:12345-192.168.201.34@tcp:101:bash.0 Request processed in 267us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969341.955053:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:1.0:1783969341.958799:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.958898:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074004352 00000100:00100000:3.0:1783969341.958908:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074004352 00000100:00100000:3.0:1783969341.959014:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:3.0:1783969341.959025:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:10844:x1870627074004352:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1783969341.959044:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969341.959077:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303912 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969341.959142:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a55363b, atime: 0x6a553639, ctime: 0x6a55363b, blocks: 0x8 00010000:00010000:3.0:1783969341.959166:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1783969341.959170:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969341.959179:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303912 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.959196:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303912 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969341.959210:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52a00, rc 0) 00000100:00100000:3.0:1783969341.959270:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+7:10844:x1870627074004352:12345-192.168.201.34@tcp:101:bash.0 Request processed in 247us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969341.959278:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:0.0:1783969341.962599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969341.962694:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074004480 00000100:00100000:3.0:1783969341.962705:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074004480 00002000:00010000:3.0:1783969341.962747:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1783969341.962752:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93ea865aa680 with x1870627074004480 ext(0->18446744073709551615) 00002000:00010000:3.0:1783969341.962763:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ea865aa680. 00000100:00100000:3.0:1783969341.962836:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1783969341.962847:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2392:x1870627074004480:12345-192.168.201.34@tcp:10:bash.0 00002000:00010000:3.0:1783969341.963139:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783969341.963143:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1783969339 -> 1783969340 00002000:00010000:3.0:1783969341.963146:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1783969337 -> 1783969337 00002000:00010000:3.0:1783969341.963148:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1783969339 -> 1783969340 00002000:00010000:3.0:1783969341.963159:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1783969341.963221:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2392:x1870627074004480:12345-192.168.201.34@tcp:10:bash.0 Request processed in 375us (630us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783969341.963229:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00002000:00010000:3.0:1783969341.963232:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1783969341.963234:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93ea865aa680 with x1870627074004480 ext(0->18446744073709551615) 00002000:00010000:3.0:1783969341.963239:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ea865aa680. 00000100:00100000:1.0:1783969342.078025:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969342.078155:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074004608 00000100:00100000:2.0:1783969342.078167:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074004608 00000100:00100000:2.0:1783969342.078232:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:2.0:1783969342.078243:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+30:11332:x1870627074004608:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1783969342.078318:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078338:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078352:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078370:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078425:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078434:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078523:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078546:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078555:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969342.078603:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078615:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078622:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078630:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078637:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969342.078641:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078649:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078660:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969342.078663:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969342.078860:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078870:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba1e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078892:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078898:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078904:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078909:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969342.078912:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078918:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078927:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e98216e600) 00010000:00010000:2.0:1783969342.078930:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969342.078932:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078938:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba1e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078953:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078959:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078965:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078979:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969342.078983:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078989:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.078997:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:2.0:1783969342.078999:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969342.079002:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.079007:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba1f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969342.079096:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+30:11332:x1870627074004608:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 853us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969342.079105:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:0.0:1783969342.128808:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.128982:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074004864 00000100:00100000:3.0:1783969342.128993:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074004864 00000100:00100000:3.0:1783969342.129088:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:3.0:1783969342.129099:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+30:11335:x1870627074004864:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969342.129121:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969342.129143:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba1f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303919 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129228:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129247:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129258:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129272:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129280:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129297:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129434:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba20c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129444:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba20c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129636:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba20c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969342.129648:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783969342.129730:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129737:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129744:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129750:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969342.129754:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129761:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129772:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:3.0:1783969342.129776:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969342.129787:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129794:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba1fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129807:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129814:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129820:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129825:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969342.129828:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129835:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129843:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93ea911e6600) 00010000:00010000:3.0:1783969342.129846:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969342.129849:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129855:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba205 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129894:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba1f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303919 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129920:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba20c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303919 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.129927:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:3.0:1783969342.129930:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783969342.129932:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52e00, rc 0) 00000100:00100000:3.0:1783969342.129998:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+32:11335:x1870627074004864:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 901us (1200us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1783969342.130006:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:0.0:1783969342.134211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.134353:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074004992 00000100:00100000:3.0:1783969342.134364:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074004992 00000100:00100000:3.0:1783969342.134643:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:3.0:1783969342.134657:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+32:11335:x1870627074004992:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:3.0:1783969342.134733:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.134752:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038fd expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.134761:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.134798:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038fd expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.134811:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038fd expref: 32 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969342.134840:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099255808:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969342.134942:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969342.139787:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d31500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099255808:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969342.139817:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969342.140633:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.142788:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074005248 00000100:00100000:3.0:1783969342.142802:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074005248 00000100:00100000:3.0:1783969342.142905:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:3.0:1783969342.142917:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+33:6163:x1870627074005248:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000001:00080000:3.0:1783969342.143221:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967373 00000100:00100000:3.0:1783969342.143418:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+35:6163:x1870627074005248:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 502us (2788us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1783969342.143427:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000020:00080000:3.0:1783969342.143432:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783969342.149265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.150063:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074005376 00000100:00100000:3.0:1783969342.150074:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074005376 00010000:00010000:3.0:1783969342.150234:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038fd expref: 35 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969342.150318:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:3.0:1783969342.150328:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+35:2392:x1870627074005376:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969342.150348:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969342.150355:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038fd expref: 35 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.150408:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038fd expref: 35 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.150433:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba1b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038fd expref: 35 pid: 6521 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.150458:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:3.0:1783969342.150463:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.150473:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.150482:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.150512:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969342.150569:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+34:2392:x1870627074005376:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 243us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969342.150577:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00010000:00010000:2.0:1783969342.150943:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.150953:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.150992:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.150998:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.151016:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.151022:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969342.151027:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.151034:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.151054:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:2.0:1783969342.151057:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969342.151061:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.151068:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba21a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969342.151134:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+33:11335:x1870627074004992:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 16474us (16926us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969342.151143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:1.0:1783969342.154332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969342.154617:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074005632 00000100:00100000:0.0:1783969342.154627:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074005632 00000100:00100000:0.0:1783969342.154713:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:0.0:1783969342.154724:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+33:11335:x1870627074005632:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969342.154985:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+34:11335:x1870627074005632:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 263us (660us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1783969342.154994:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1783969342.219365:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969342.219438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969342.219619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074005760 00000100:00100000:2.0:1783969342.219629:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074005760 00000100:00100000:2.0:1783969342.219689:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 393 00000100:00100000:2.0:1783969342.219698:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074005760:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969342.219773:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074005760:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 76us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969342.219780:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 393 00000100:00100000:3.0:1783969342.220288:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074006016 00000100:00100000:3.0:1783969342.220293:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074006016 00000100:00100000:3.0:1783969342.220344:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 317 00000100:00100000:3.0:1783969342.220351:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074006016:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969342.220425:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074006016:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 74us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969342.220431:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 317 00000100:00080000:1.0:1783969342.220583:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969342.222472:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969342.222516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969342.222544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969342.222582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969342.222605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969342.222634:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074006528 00000100:00100000:1.0:1783969342.222643:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074006528 00000100:00100000:1.0:1783969342.222706:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074005888 00000100:00100000:1.0:1783969342.222710:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074005888 00000100:00100000:1.0:1783969342.222727:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074006400 00000100:00100000:1.0:1783969342.222730:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074006400 00000100:00100000:1.0:1783969342.222753:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 318 00000100:00100000:1.0:1783969342.222762:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074006528:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969342.222829:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074006528:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 68us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969342.222837:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 318 00000100:00100000:1.0:1783969342.222854:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 319 00000100:00100000:1.0:1783969342.222861:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+34:2391:x1870627074005888:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969342.222892:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+34:2391:x1870627074005888:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969342.222898:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 319 00000100:00100000:1.0:1783969342.222909:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 320 00000100:00100000:1.0:1783969342.222915:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074006400:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969342.222936:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074006400:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969342.222942:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 320 00000100:00080000:1.0:1783969342.222958:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969342.222961:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969342.223361:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074006272 00000100:00100000:0.0:1783969342.223367:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074006272 00000100:00100000:0.0:1783969342.223428:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074006144 00000100:00100000:0.0:1783969342.223432:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074006144 00000100:00100000:0.0:1783969342.223473:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:0.0:1783969342.223481:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074006272:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969342.223522:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074006272:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 42us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969342.223528:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:0.0:1783969342.223541:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:0.0:1783969342.223546:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074006144:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969342.223580:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074006144:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 34us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969342.223587:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00080000:0.0:1783969342.223608:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783969342.256823:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969342.274582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969342.274796:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074006784 00000100:00100000:0.0:1783969342.274806:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074006784 00000100:00100000:0.0:1783969342.274905:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:0.0:1783969342.274916:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+34:11346:x1870627074006784:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1783969342.274937:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969342.274958:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba221 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303920 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275030:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275071:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275084:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275102:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275109:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275115:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275270:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba236 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275279:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275287:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969342.275297:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1783969342.275401:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275410:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275417:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275424:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969342.275429:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275436:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275520:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969342.275524:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969342.275529:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275545:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba228 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275561:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275567:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275573:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275579:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969342.275582:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275588:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275597:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93ea98408400) 00010000:00010000:0.0:1783969342.275600:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969342.275602:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275608:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba22f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275651:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba221 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303920 expref: 37 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275769:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba236 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303920 expref: 36 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.275784:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:0.0:1783969342.275786:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969342.275788:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdfa00, rc 0) 00000100:00100000:0.0:1783969342.275866:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+36:11346:x1870627074006784:12345-192.168.201.34@tcp:101:cat.0 Request processed in 951us (1294us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1783969342.275875:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:2.0:1783969342.281184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.281356:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074007040 00000100:00100000:3.0:1783969342.281364:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074007040 00000100:00100000:3.0:1783969342.281440:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1783969342.281459:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+36:11346:x1870627074007040:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:3.0:1783969342.281748:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+37:11346:x1870627074007040:12345-192.168.201.34@tcp:35:cat.0 Request processed in 289us (573us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1783969342.281756:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:2.0:1783969342.301789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969342.301893:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074007296 00000100:00100000:1.0:1783969342.301904:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074007296 00000100:00100000:1.0:1783969342.301965:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:1.0:1783969342.301976:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+37:11347:x1870627074007296:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:1.0:1783969342.302038:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1783969342.302077:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba1d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630390b expref: 37 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.302098:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba236 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303920 expref: 36 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.302123:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba20c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303919 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.302227:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba1c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303904 expref: 34 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.302236:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:1.0:1783969342.302241:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969342.302266:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.302279:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.302289:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.302303:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.302325:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.302332:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.303003:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.303018:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.303027:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783969342.304620:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1783969342.304629:0:13769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404432247484ns, next at 405432246030ns, rc = 0 00010000:00010000:1.0:1783969342.304683:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304695:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304703:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304709:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304714:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304731:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304788:0:13769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969342.304808:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304812:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304819:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304826:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2177600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969342.304830:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304837:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304850:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:1.0:1783969342.304853:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783969342.304857:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304873:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba252 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304903:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304907:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304915:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304919:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969342.304920:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304926:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304934:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:1.0:1783969342.304937:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969342.304939:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304944:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba244 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969342.304956:0:13769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048128c16 reply state 0000000033d16614 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304967:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.304973:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982253700) 00010000:00010000:1.0:1783969342.304975:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783969342.304978:0:13769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783969342.305078:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+35:11347:x1870627074007296:12345-192.168.201.34@tcp:36:rm.0 Request processed in 3097us (3290us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1783969342.305087:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 106 00010000:00010000:0.0:1783969342.306025:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969342.306034:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.306051:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969342.306054:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.306061:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.306072:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:0.0:1783969342.306075:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783969342.306078:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.306083:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba259 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.306100:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969342.306101:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969342.306103:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969342.392021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969342.392161:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074007552 00000100:00100000:2.0:1783969342.392179:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074007552 00000100:00100000:2.0:1783969342.392277:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:2.0:1783969342.392288:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+35:11353:x1870627074007552:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1783969342.392316:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969342.392338:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba260 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303927 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.392660:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.393364:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.393377:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.393419:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.393428:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.393435:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969342.394619:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1783969342.395053:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395228:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395241:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395282:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395289:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395298:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395305:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969342.395310:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395318:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395331:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:3.0:1783969342.395334:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969342.395338:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395345:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba267 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969342.395360:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097968632 reply state 00000000d508d7a8 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395437:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395446:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982253700) 00010000:00010000:3.0:1783969342.395448:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969342.395452:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783969342.395494:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba260 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303927 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395510:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303927 expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.395518:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6600) 00010000:00010000:3.0:1783969342.395520:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969342.395523:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52800, rc 0) 00000100:00100000:3.0:1783969342.395603:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+38:11353:x1870627074007552:12345-192.168.201.34@tcp:101:bash.0 Request processed in 3315us (3598us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1783969342.395613:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:2.0:1783969342.403620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969342.403905:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074007680 00000100:00100000:0.0:1783969342.403929:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074007680 00000100:00100000:0.0:1783969342.403994:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:0.0:1783969342.404002:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2394:x1870627074007680:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969342.404019:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969342.404048:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630392e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969342.404074:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969342.404095:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1783969342.404099:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969342.404111:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630392e expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.404142:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630392e expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.404156:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdee00, rc 0) 00000100:00100000:0.0:1783969342.404215:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2394:x1870627074007680:12345-192.168.201.34@tcp:101:bash.0 Request processed in 213us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969342.404222:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1783969342.408175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969342.408290:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074007808 00000100:00100000:0.0:1783969342.408300:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074007808 00000100:00100000:0.0:1783969342.408451:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1783969342.408462:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:11353:x1870627074007808:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969342.408481:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969342.408499:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303935 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.408549:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630392e expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.408559:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969342.408564:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969342.408569:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.408605:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630392e expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.408619:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630392e expref: 9 pid: 8436 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969342.408633:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1870627099255936:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969342.408732:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419000 going to sleep for 11 seconds 00000100:00100000:0.0:1783969342.423890:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1870627099255936:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969342.423929:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.423952:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf200, rc 0) 00000100:00100000:0.0:1783969342.424028:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+9:11353:x1870627074007808:12345-192.168.201.34@tcp:101:bash.0 Request processed in 15564us (15859us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969342.424046:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:2.0:1783969342.427248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.427425:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074007936 00000100:00100000:3.0:1783969342.427438:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074007936 00010000:00010000:3.0:1783969342.427486:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630392e expref: 9 pid: 8436 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969342.427535:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:3.0:1783969342.427544:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2392:x1870627074007936:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969342.427563:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969342.427603:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630392e expref: 9 pid: 8436 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.427618:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630392e expref: 9 pid: 8436 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.427642:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cba283 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630392e expref: 9 pid: 8436 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.427664:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969342.427669:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969342.427679:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.427690:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.427735:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969342.427753:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d32680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1870627099256064:192.168.201.34@tcp:105: 00000100:00100000:3.0:1783969342.427845:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9822350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969342.430691:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d32680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1870627099256064:192.168.201.34@tcp:105: 00010000:00010000:3.0:1783969342.430721:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969342.430813:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2392:x1870627074007936:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 3269us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969342.430838:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:2.0:1783969342.438206:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.438797:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074008192 00000100:00100000:3.0:1783969342.438810:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074008192 00000100:00100000:3.0:1783969342.438879:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:3.0:1783969342.438890:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+38:11353:x1870627074008192:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1783969342.439233:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+39:11353:x1870627074008192:12345-192.168.201.34@tcp:35:bash.0 Request processed in 343us (1036us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1783969342.439242:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:1.0:1783969342.717115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.717456:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074008320 00000100:00100000:3.0:1783969342.717466:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074008320 00000100:00100000:3.0:1783969342.717531:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:3.0:1783969342.717541:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+39:11369:x1870627074008320:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969342.717564:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969342.717584:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630393c expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.717647:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba298 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.717662:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.717686:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969342.717743:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783969342.717747:0:7749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969342.717783:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.717805:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630393c expref: 41 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.717821:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba298 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630393c expref: 40 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.717830:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:3.0:1783969342.717833:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969342.717835:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53600, rc 0) 00000100:00100000:3.0:1783969342.718113:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+40:11369:x1870627074008320:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 572us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969342.718121:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:0.0:1783969342.733106:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.733237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074008576 00000100:00100000:3.0:1783969342.733246:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074008576 00000100:00100000:3.0:1783969342.733310:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:3.0:1783969342.733321:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+40:11369:x1870627074008576:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969342.733341:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969342.733363:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba29f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303943 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.733501:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba2a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.733516:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.733527:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969342.733552:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783969342.733654:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba29f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303943 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.733685:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303943 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.733693:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6600) 00010000:00010000:3.0:1783969342.733696:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969342.733699:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53400, rc 0) 00000100:00100000:3.0:1783969342.733771:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+42:11369:x1870627074008576:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 452us (675us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1783969342.733778:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:2.0:1783969342.746638:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969342.746697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969342.746903:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074008832 00000100:00100000:0.0:1783969342.746913:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074008832 00000100:00100000:0.0:1783969342.746980:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:0.0:1783969342.746991:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+42:11369:x1870627074008832:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969342.747017:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969342.747046:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba2b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630394a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.747153:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba2bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.747168:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba2bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.747180:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba2bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969342.747192:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783969342.747293:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba2b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630394a expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.747312:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba2bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630394a expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.747320:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6600) 00010000:00010000:0.0:1783969342.747324:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783969342.747327:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde400, rc 0) 00000100:00100000:0.0:1783969342.747428:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+44:11369:x1870627074008832:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 438us (798us total) trans 4294967382 rc 0/0 00000100:00100000:0.0:1783969342.747453:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:3.0:1783969342.748149:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074008960 00000100:00100000:3.0:1783969342.748156:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074008960 00000100:00100000:3.0:1783969342.748208:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1783969342.748217:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab211b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+44:2394:x1870627074008960:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969342.748231:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969342.748248:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba2a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303943 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.748262:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6600) 00010000:00010000:3.0:1783969342.748266:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969342.748307:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab211b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+43:2394:x1870627074008960:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 92us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969342.748314:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1783969342.756838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969342.757054:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074009088 00000100:00100000:0.0:1783969342.757065:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074009088 00000100:00100000:0.0:1783969342.757138:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1783969342.757149:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074009088:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:0.0:1783969342.757191:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.757213:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.757222:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969342.757226:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969342.757231:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.757265:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.757279:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 8 pid: 8439 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969342.757295:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1870627099256192:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969342.757426:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969342.765979:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969342.766134:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1870627099256192:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969342.766173:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969342.766285:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074009216 00000100:00100000:3.0:1783969342.766292:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074009216 00002000:00100000:3.0:1783969342.766338:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff93eabf851500 x1870627074009216/t0(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:238/0 lens 504/0 e 0 to 0 dl 1783969353 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969342.766348:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eabf851500 with x1870627074009216 ext(0->8) 00010000:00010000:3.0:1783969342.766355:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 9 pid: 8439 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.766369:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 9 pid: 8439 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969342.766377:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93eabf851500 00000100:00100000:3.0:1783969342.766445:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1783969342.766456:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2391:x1870627074009216:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:3.0:1783969342.768326:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+11:2391:x1870627074009216:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 1860us (2345us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783969342.768342:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00002000:00100000:3.0:1783969342.768353:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff93eabf851500 x1870627074009216/t4294967303(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:238/0 lens 504/448 e 0 to 0 dl 1783969353 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969342.768364:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eabf851500 with x1870627074009216 ext(0->8) 00010000:00010000:3.0:1783969342.768374:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 11 pid: 8439 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.768430:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 11 pid: 8439 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969342.768456:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93eabf851500 00000100:00100000:2.0:1783969342.780023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969342.780131:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074009344 00000100:00100000:1.0:1783969342.780139:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074009344 00010000:00010000:1.0:1783969342.780177:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 11 pid: 8439 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969342.780226:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1783969342.780236:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf864e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+11:2393:x1870627074009344:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969342.780252:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783969342.780270:0:7929:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783969342.780273:0:7929:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783969341 00002000:00010000:1.0:1783969342.780275:0:7929:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783969341 00002000:00010000:1.0:1783969342.780277:0:7929:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1783969341 00002000:00010000:1.0:1783969342.780278:0:7929:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1783969342.780284:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 11 pid: 8439 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.780298:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 11 pid: 8439 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.780321:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001656b5f1/0xea31253a47cba28a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303935 expref: 11 pid: 8439 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.780340:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783969342.780344:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783969342.780350:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.780372:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.780450:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969342.780499:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf864e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2393:x1870627074009344:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 264us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969342.780506:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00010000:00010000:0.0:1783969342.780654:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.780665:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.780685:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.780693:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.780702:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.780709:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969342.780713:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.780721:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.780734:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.780749:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f71882dd/0xea31253a47cba2c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969342.780797:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2391:x1870627074009088:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 23651us (23970us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969342.780806:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1783969342.785168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.785256:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074009600 00000100:00100000:3.0:1783969342.785266:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074009600 00000100:00100000:3.0:1783969342.785324:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1783969342.785335:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+43:11369:x1870627074009600:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:3.0:1783969342.785434:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba2bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630394a expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969342.785847:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1783969342.785890:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:3.0:1783969342.786472:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:2.0:1783969342.792815:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.792846:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303927 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.792856:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.792932:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303927 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969342.792948:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303927 expref: 47 pid: 6523 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969342.792967:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf867100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1870627099256320:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969342.793083:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969342.800212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.800281:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074009728 00000100:00100000:3.0:1783969342.800291:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074009728 00010000:00010000:3.0:1783969342.800335:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303927 expref: 48 pid: 6523 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969342.800352:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf867100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1870627099256320:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969342.800412:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:3.0:1783969342.800423:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf865180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+48:2392:x1870627074009728:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969342.800439:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969342.800447:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303927 expref: 48 pid: 6523 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.800459:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303927 expref: 48 pid: 6523 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.800484:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba275 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303927 expref: 48 pid: 6523 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.800497:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.800515:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6600) 00010000:00010000:3.0:1783969342.800520:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.800529:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.800536:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.800598:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969342.800713:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.800721:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969342.800840:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:0.0:1783969342.800977:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1783969342.801079:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e02680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099256448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783969342.801130:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969342.801167:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969342.801208:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099256448 00000100:00100000:3.0:1783969342.801213:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099256448 00000100:00100000:3.0:1783969342.801266:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783969342.801273:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1870627099256448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783969342.801340:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf865180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+49:2392:x1870627074009728:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 916us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969342.801349:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:3.0:1783969342.801359:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1870627099256448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969342.801365:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1783969342.801434:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969342.801468:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e02680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099256448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783969342.801564:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:0.0:1783969342.801601:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e02680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099256576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783969342.801625:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969342.803657:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419300 going to sleep for 11 seconds 00000100:00100000:3.0:1783969342.803710:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099256576 00000100:00100000:3.0:1783969342.803720:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099256576 00000100:00100000:3.0:1783969342.803809:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783969342.803820:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1870627099256576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783969342.804190:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6524:x1870627099256576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 371us (2563us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783969342.804198:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783969342.804293:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e02680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099256576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783969342.804358:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1783969342.804424:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.804434:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.804441:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.804447:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969342.804452:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.804459:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.804487:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6600) 00010000:00010000:1.0:1783969342.804490:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783969342.804494:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969342.804500:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba2d0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783969342.804730:0:6524:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783969342.804793:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1783969342.804805:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404932423132ns, next at 405932420984ns, rc = 0 00000001:00080000:1.0:1783969342.804812:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:1.0:1783969342.804836:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6600) 00010000:00010000:1.0:1783969342.804838:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783969342.804843:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba2bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630394a expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969342.805770:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+50:11369:x1870627074009600:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 20431us (20606us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1783969342.805783:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000020:00080000:1.0:1783969342.805789:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783969342.808460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.808784:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074009856 00000100:00100000:3.0:1783969342.808794:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074009856 00000100:00100000:3.0:1783969342.808850:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:3.0:1783969342.808875:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+50:11369:x1870627074009856:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969342.808967:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969342.808988:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba2d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303951 expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.809050:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303951 expref: 51 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.809068:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303951 expref: 51 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.809499:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:3.0:1783969342.809502:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969342.809505:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53400, rc 0) 00000100:00100000:3.0:1783969342.809626:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+51:11369:x1870627074009856:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 737us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969342.809635:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:3.0:1783969342.815443:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969342.815673:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074010112 00000100:00100000:2.0:1783969342.815684:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074010112 00000100:00100000:2.0:1783969342.815745:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:2.0:1783969342.815755:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+51:11369:x1870627074010112:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1783969342.816027:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+52:11369:x1870627074010112:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 272us (591us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783969342.816065:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:2.0:1783969342.919374:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969342.919669:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074010240 00000100:00100000:3.0:1783969342.919680:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074010240 00000100:00100000:3.0:1783969342.919786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:3.0:1783969342.919797:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+52:11380:x1870627074010240:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:3.0:1783969342.919875:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.919894:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.919936:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.919948:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.919955:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.919962:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920057:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920065:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920070:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969342.920130:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920144:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920149:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920155:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920171:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969342.920175:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920182:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920194:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:3.0:1783969342.920196:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969342.920200:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920206:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba2de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920219:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920225:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920230:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920235:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969342.920237:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920243:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920262:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982253700) 00010000:00010000:3.0:1783969342.920264:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969342.920267:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920278:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba2e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920289:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920294:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920299:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920303:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969342.920306:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920311:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920317:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:3.0:1783969342.920319:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969342.920321:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969342.920327:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba2ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969342.920465:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+52:11380:x1870627074010240:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 669us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969342.920473:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:3.0:1783969342.988946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969342.989734:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074010496 00000100:00100000:0.0:1783969342.989745:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074010496 00000100:00100000:0.0:1783969342.989867:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:0.0:1783969342.989878:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+52:11383:x1870627074010496:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969342.989897:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969342.989926:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba2f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303958 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.989997:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990011:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990024:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990047:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990056:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990073:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990347:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba308 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990357:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990399:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969342.990410:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783969342.990492:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990499:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990504:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990510:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdec00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969342.990514:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990520:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990533:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969342.990536:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969342.990541:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990546:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba2fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990559:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990564:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990576:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990581:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969342.990584:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990589:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990597:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982253700) 00010000:00010000:0.0:1783969342.990599:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969342.990602:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990606:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba301 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990642:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba2f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303958 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990657:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba308 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303958 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.990676:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969342.990678:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969342.990681:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf200, rc 0) 00000100:00100000:0.0:1783969342.990747:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+54:11383:x1870627074010496:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 871us (1812us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1783969342.992582:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:2.0:1783969342.994965:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969342.995045:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074010624 00000100:00100000:0.0:1783969342.995054:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074010624 00000100:00100000:0.0:1783969342.995163:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:0.0:1783969342.995173:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+54:11383:x1870627074010624:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1783969342.995242:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.995259:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.995454:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.995493:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.995501:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.995508:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.995513:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdee00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969342.995517:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.995524:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.995536:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969342.995554:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969342.995559:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969342.995565:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba316 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969342.995687:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+54:11383:x1870627074010624:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 515us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969342.995696:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:2.0:1783969343.004219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.005319:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074010880 00000100:00100000:0.0:1783969343.005332:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074010880 00000100:00100000:1.0:1783969343.005563:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:1.0:1783969343.005576:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+54:11383:x1870627074010880:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1783969343.005850:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+55:11383:x1870627074010880:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 276us (1639us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1783969343.005859:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00080000:0.0:1783969343.006124:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969343.156516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.156633:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074011136 00000100:00100000:1.0:1783969343.156657:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074011136 00000100:00100000:1.0:1783969343.156730:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:1.0:1783969343.156741:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+55:11393:x1870627074011136:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1783969343.156766:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969343.156770:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783969343.156798:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba298 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630393c expref: 55 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.156818:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:1.0:1783969343.156823:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969343.156849:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba31d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630395f expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.156967:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba324 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.156981:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.156993:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969343.157003:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783969343.157230:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba31d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630395f expref: 57 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.157261:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba324 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630395f expref: 56 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.157267:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:1.0:1783969343.157276:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969343.157280:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2176a00, rc 0) 00000100:00100000:1.0:1783969343.157348:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+56:11393:x1870627074011136:12345-192.168.201.34@tcp:101:bash.0 Request processed in 607us (840us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1783969343.157355:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:2.0:1783969343.166913:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969343.167010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.167276:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074011392 00000100:00100000:3.0:1783969343.167287:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074011392 00000100:00100000:3.0:1783969343.167351:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:3.0:1783969343.167362:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+56:11393:x1870627074011392:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1783969343.167436:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969343.167462:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba332 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303966 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.167504:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.167521:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.167536:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.167673:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba332 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303966 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.167692:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303966 expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.167701:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:3.0:1783969343.167711:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783969343.167715:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53000, rc 0) 00000100:00100000:1.0:1783969343.168068:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074011264 00000100:00100000:1.0:1783969343.168084:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074011264 00000100:00100000:1.0:1783969343.168123:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1783969343.168131:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf866d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+58:2393:x1870627074011264:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969343.168143:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969343.168159:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba324 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630395f expref: 58 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.168186:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:1.0:1783969343.168190:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969343.168245:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf866d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+57:2393:x1870627074011264:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 115us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.168253:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1783969343.168662:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+56:11393:x1870627074011392:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1300us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.168670:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:2.0:1783969343.185233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.185331:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074011648 00000100:00100000:3.0:1783969343.185341:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074011648 00000100:00100000:0.0:1783969343.185716:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:0.0:1783969343.185742:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+56:11393:x1870627074011648:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:0.0:1783969343.185812:0:9027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969343.185853:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba308 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303958 expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.185874:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969343.185878:0:9027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969343.186063:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.186087:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.186096:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969343.186140:0:9027:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:0.0:1783969343.186180:0:9027:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d0be84d reply state 00000000908c21ce transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.186193:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.186200:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969343.186203:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783969343.186205:0:9027:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969343.186311:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+58:11393:x1870627074011648:12345-192.168.201.34@tcp:36:bash.0 Request processed in 584us (1089us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1783969343.186318:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000020:00080000:0.0:1783969343.186322:0:9027:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783969343.190913:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.191179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074011776 00000100:00100000:0.0:1783969343.191189:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074011776 00000100:00100000:0.0:1783969343.191258:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:0.0:1783969343.191269:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+58:11393:x1870627074011776:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969343.191298:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.191317:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba347 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630396d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.191477:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.191492:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.191504:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969343.191537:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783969343.191548:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969343.191572:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.191597:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba347 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630396d expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.191617:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630396d expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.191627:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969343.191630:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969343.191633:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdec00, rc 0) 00000100:00100000:0.0:1783969343.191688:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+59:11393:x1870627074011776:12345-192.168.201.34@tcp:101:bash.0 Request processed in 421us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.191696:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:2.0:1783969343.203124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.204107:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074012032 00000100:00100000:1.0:1783969343.204119:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074012032 00000100:00100000:1.0:1783969343.204201:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:1.0:1783969343.204213:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+59:11393:x1870627074012032:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1783969343.204633:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+60:11393:x1870627074012032:12345-192.168.201.34@tcp:35:bash.0 Request processed in 420us (1519us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1783969343.204642:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00010000:00010000:1.0:1783969343.281009:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969343.392527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.392692:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074012160 00000100:00100000:0.0:1783969343.392703:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074012160 00000100:00100000:0.0:1783969343.392768:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:0.0:1783969343.392778:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+60:11399:x1870627074012160:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969343.392802:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.392823:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303974 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.392890:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba35c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.392907:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba35c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.392938:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba35c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969343.392994:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783969343.392999:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969343.393020:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba35c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.393059:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303974 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.393078:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba35c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303974 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.393087:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969343.393090:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969343.393444:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf200, rc 0) 00000100:00100000:0.0:1783969343.393523:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+61:11399:x1870627074012160:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 745us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.393530:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:3.0:1783969343.410587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.410701:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074012288 00000100:00100000:0.0:1783969343.410711:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074012288 00000100:00100000:0.0:1783969343.410780:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:0.0:1783969343.410791:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+61:11399:x1870627074012288:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969343.410816:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.410840:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba363 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630397b expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.410928:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.410943:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.410957:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.410971:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.410979:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.410985:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411089:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411114:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411122:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969343.411163:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783969343.411167:0:9027:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969343.411184:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411206:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411215:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411221:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411227:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411234:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969343.411239:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411247:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411258:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969343.411261:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969343.411266:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411272:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba36a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411288:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411293:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411305:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411309:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdfa00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969343.411312:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411318:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411325:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982253700) 00010000:00010000:0.0:1783969343.411327:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969343.411330:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411335:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba371 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411364:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba363 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 63 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411377:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 62 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.411445:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969343.411447:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969343.411449:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdee00, rc 0) 00000100:00100000:0.0:1783969343.411520:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11399:x1870627074012288:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 730us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.411539:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:2.0:1783969343.421475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.421586:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074012544 00000100:00100000:0.0:1783969343.421599:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074012544 00000100:00100000:0.0:1783969343.421675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1783969343.421686:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11399:x1870627074012544:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969343.421708:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.421729:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba37f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303982 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.421839:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.421854:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630396d expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.421862:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 63 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.421871:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.421905:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 63 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.421918:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 63 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969343.421930:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e01180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099256704:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969343.422064:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630396d expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.422073:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630396d expref: 63 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969343.422082:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099256832:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969343.422314:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419480 going to sleep for 11 seconds 00000100:00100000:3.0:1783969343.431005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.431321:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074012672 00000100:00100000:1.0:1783969343.431330:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074012672 00010000:00010000:1.0:1783969343.431375:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 64 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.431445:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:1.0:1783969343.431455:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+64:2392:x1870627074012672:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969343.431471:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969343.431478:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 64 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.431492:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 64 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.431530:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:1.0:1783969343.431536:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.431546:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.431552:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969343.431611:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+64:2392:x1870627074012672:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 156us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.431619:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00010000:00010000:0.0:1783969343.434457:0:6522:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.34@tcp) returned -22 from blocking AST (req@00000000268e5a15 x1870627099256704) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 63 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.434481:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba378 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630397b expref: 63 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969343.434498:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e01180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099256704:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969343.434514:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099256832:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969343.434536:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969343.434542:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.434552:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.434562:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.434629:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.434825:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074012800 00000100:00100000:0.0:1783969343.434846:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074012800 00010000:00010000:0.0:1783969343.434881:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630396d expref: 63 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969343.434925:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:0.0:1783969343.434935:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+63:2391:x1870627074012800:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969343.434950:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969343.434956:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630396d expref: 63 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.434967:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630396d expref: 63 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.434987:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba34e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630396d expref: 63 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.434997:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969343.435001:0:7929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.435008:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.435015:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.435046:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969343.435098:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+62:2391:x1870627074012800:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 163us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.435124:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00010000:00010000:3.0:1783969343.435236:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.435243:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969343.435261:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783969343.435417:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba37f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303982 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.435433:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303982 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.435440:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:3.0:1783969343.435443:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783969343.435445:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdfa00, rc 0) 00000100:00100000:3.0:1783969343.435471:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11399:x1870627074012544:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 13787us (14009us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1783969343.435478:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:2.0:1783969343.440706:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.440911:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074013056 00000100:00100000:1.0:1783969343.440921:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074013056 00000100:00100000:1.0:1783969343.441013:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1783969343.441034:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf864380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11399:x1870627074013056:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:1.0:1783969343.441054:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969343.441084:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba2d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303951 expref: 62 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.441103:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:1.0:1783969343.441109:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969343.441187:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf864380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+61:11399:x1870627074013056:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 164us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.441196:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1783969343.458190:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.458372:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074013184 00000100:00100000:3.0:1783969343.458440:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074013184 00000100:00100000:3.0:1783969343.458499:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:3.0:1783969343.458510:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+61:11399:x1870627074013184:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:3.0:1783969343.458640:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.458660:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.458671:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969343.458770:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1783969343.458864:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+61:11399:x1870627074013184:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 355us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.458872:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:2.0:1783969343.463182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.463535:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074013312 00000100:00100000:0.0:1783969343.463546:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074013312 00000100:00100000:0.0:1783969343.463625:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:0.0:1783969343.463637:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+61:11399:x1870627074013312:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969343.463660:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.463683:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303989 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.463738:0:9027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.463749:0:9027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303989 expref: 62 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.463772:0:9027:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.463786:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303989 expref: 62 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.463800:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969343.463804:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969343.463808:0:9027:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303989 expref: 62 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.463815:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdec00, rc 0) 00000100:00100000:0.0:1783969343.463929:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11399:x1870627074013312:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 295us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.463937:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 123 00000040:00080000:1.0:1783969343.472848:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969343.472859:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969343.472905:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1783969343.472917:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783969343.473069:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983741880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099256960:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783969343.473197:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5a11900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969343.480806:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983741880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099256960:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783969343.481813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.482018:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074013440 00000100:00100000:1.0:1783969343.482035:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074013440 00000100:00100000:1.0:1783969343.482102:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:1.0:1783969343.482128:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11400:x1870627074013440:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783969343.482168:0:13769:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783969343.482295:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11400:x1870627074013440:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 173us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.482320:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:2.0:1783969343.493366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.494939:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074013568 00000100:00100000:3.0:1783969343.494954:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074013568 00000100:00100000:3.0:1783969343.495038:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:3.0:1783969343.495051:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11400:x1870627074013568:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783969343.495148:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495166:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495179:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495194:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495217:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495223:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495247:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495255:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495261:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969343.495305:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783969343.495309:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969343.495322:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495332:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495337:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495343:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495349:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.495353:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495365:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495744:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:3.0:1783969343.495750:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969343.495755:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495762:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba3a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495777:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495783:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495789:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495794:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.495797:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495802:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495810:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff93ea911e6700) 00010000:00010000:3.0:1783969343.495813:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969343.495815:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495831:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba3a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495849:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495854:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495859:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495864:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.495867:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495872:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495879:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:3.0:1783969343.495881:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969343.495884:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.495888:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969343.495982:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11400:x1870627074013568:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 932us (2626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.495990:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:2.0:1783969343.505790:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.505876:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074013824 00000100:00100000:0.0:1783969343.505886:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074013824 00000100:00100000:0.0:1783969343.505956:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:0.0:1783969343.505968:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+62:11400:x1870627074013824:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969343.505991:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.506016:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba3b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303990 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506166:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506184:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506195:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969343.506207:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783969343.506284:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506291:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506298:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506304:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969343.506320:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506328:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506340:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969343.506343:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783969343.506347:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506354:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506440:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba3b7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303990 expref: 64 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506450:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:0.0:1783969343.506452:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969343.506456:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba3b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303990 expref: 64 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.506466:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdee00, rc 0) 00000100:00100000:0.0:1783969343.506636:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+63:11400:x1870627074013824:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 671us (862us total) trans 4294967400 rc 301/301 00000100:00100000:0.0:1783969343.506645:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:2.0:1783969343.511058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.511149:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074013952 00000100:00100000:3.0:1783969343.511160:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074013952 00000100:00100000:3.0:1783969343.511227:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:3.0:1783969343.511238:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+63:11400:x1870627074013952:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783969343.511278:0:6522:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783969343.511666:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+63:11400:x1870627074013952:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 428us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.511676:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:2.0:1783969343.522809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.523102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074014208 00000100:00100000:0.0:1783969343.523127:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074014208 00000100:00100000:0.0:1783969343.523232:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 128 00000100:00100000:0.0:1783969343.523244:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+63:11400:x1870627074014208:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969343.523280:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.523283:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783969343.523314:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba35c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303974 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.523335:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969343.523340:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969343.523353:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba3cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303997 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969343.523803:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1783969343.523947:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.523960:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.523971:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.524018:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba3cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303997 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.524046:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303997 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.524054:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93ea98408600) 00010000:00010000:0.0:1783969343.524069:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969343.524079:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde600, rc 0) 00000100:00100000:0.0:1783969343.524148:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+64:11400:x1870627074014208:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 906us (1350us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1783969343.524155:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 128 00000100:00100000:2.0:1783969343.531064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.531409:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074014464 00000100:00100000:0.0:1783969343.531421:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074014464 00000100:00100000:0.0:1783969343.531484:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:0.0:1783969343.531494:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+64:11400:x1870627074014464:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783969343.531567:0:9027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969343.531597:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba3d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303997 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531617:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93ea98408600) 00010000:00010000:0.0:1783969343.531628:0:9027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969343.531651:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531665:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531676:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531691:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531698:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531705:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531762:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531770:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531776:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531782:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969343.531786:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531793:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531802:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:0.0:1783969343.531805:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969343.531809:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531815:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba3e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531824:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531830:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531835:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531845:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969343.531848:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531854:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531862:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x708441df (ffff93ea98408f00) 00010000:00010000:0.0:1783969343.531864:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969343.531866:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.531872:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba3e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x708441df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969343.531965:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+63:11400:x1870627074014464:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 471us (916us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783969343.531973:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:2.0:1783969343.542628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.542730:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074014592 00000100:00100000:1.0:1783969343.542741:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074014592 00000100:00100000:1.0:1783969343.542805:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:1.0:1783969343.542816:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+63:11400:x1870627074014592:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969343.542838:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969343.542862:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba3ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d35630399e expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.542899:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.542912:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.542922:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.543056:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba3ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630399e expref: 65 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.543092:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630399e expref: 64 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.543101:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:1.0:1783969343.543104:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783969343.543284:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2176800, rc 0) 00000100:00100000:1.0:1783969343.543359:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+64:11400:x1870627074014592:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 543us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.543374:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:2.0:1783969343.562523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.562881:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074014848 00000100:00100000:3.0:1783969343.562892:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074014848 00000100:00100000:3.0:1783969343.562942:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:3.0:1783969343.562952:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+64:11400:x1870627074014848:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969343.563049:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.563066:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.563077:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969343.563774:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1783969343.563796:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405691414605ns, next at 406691410907ns, rc = 0 00000004:00010000:3.0:1783969343.563856:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ec8354c reply state 0000000068b59a5e transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.563871:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.563897:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:3.0:1783969343.563900:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783969343.563904:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969343.564038:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+66:11400:x1870627074014848:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1085us (1522us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1783969343.564047:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:2.0:1783969343.580093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.580205:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074014976 00000100:00100000:0.0:1783969343.580217:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074014976 00000100:00100000:0.0:1783969343.580288:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:0.0:1783969343.580299:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+66:11400:x1870627074014976:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969343.580324:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.580347:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039a5 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.580444:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039a5 expref: 67 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.580480:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039a5 expref: 67 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.580517:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:0.0:1783969343.580521:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969343.580524:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797e00, rc 0) 00000100:00100000:0.0:1783969343.580584:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+67:11400:x1870627074014976:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 288us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.580590:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:2.0:1783969343.595994:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.596140:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074015104 00000100:00100000:1.0:1783969343.596152:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074015104 00000100:00080000:0.0:1783969343.596299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969343.596482:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1783969343.596495:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2392:x1870627074015104:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783969343.596736:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2392:x1870627074015104:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 243us (750us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783969343.596744:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:2.0:1783969343.603269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.603361:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074015360 00000100:00100000:3.0:1783969343.603377:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074015360 00000100:00100000:3.0:1783969343.603469:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:3.0:1783969343.603480:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+67:11400:x1870627074015360:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783969343.603703:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+68:11400:x1870627074015360:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 224us (446us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1783969343.603711:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1783969343.615998:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.618766:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074015616 00000100:00100000:3.0:1783969343.618783:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074015616 00000100:00100000:3.0:1783969343.618866:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:3.0:1783969343.618878:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+68:11400:x1870627074015616:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783969343.619014:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+68:11400:x1870627074015616:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 137us (3026us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.619033:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:0.0:1783969343.624679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.624858:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074015744 00000100:00100000:3.0:1783969343.624869:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074015744 00000100:00100000:3.0:1783969343.624927:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:3.0:1783969343.624936:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+68:11400:x1870627074015744:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969343.624955:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969343.624988:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba40b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039ac expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.625070:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba412 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.625087:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba412 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.625099:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba412 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969343.625159:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969343.625178:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba412 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.625205:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba40b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ac expref: 70 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.625221:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba412 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ac expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.625230:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:3.0:1783969343.625233:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783969343.625236:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52800, rc 0) 00000100:00100000:3.0:1783969343.625306:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+69:11400:x1870627074015744:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 371us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.625314:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:2.0:1783969343.634479:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.634591:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074015872 00000100:00100000:0.0:1783969343.634601:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074015872 00000100:00100000:0.0:1783969343.634671:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:0.0:1783969343.634681:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2391:x1870627074015872:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969343.634702:0:9974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.634727:0:9974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039b3 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969343.634758:0:9974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a55363e, blocks: 0x0 00010000:00010000:0.0:1783969343.634780:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1783969343.634785:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969343.634796:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039b3 expref: 10 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.634836:0:9974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039b3 expref: 10 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.634849:0:9974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797a00, rc 0) 00000100:00100000:0.0:1783969343.634916:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2391:x1870627074015872:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 235us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.634923:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1783969343.640042:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.640152:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074016128 00000100:00100000:0.0:1783969343.640161:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074016128 00000100:00100000:0.0:1783969343.640227:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:0.0:1783969343.640239:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+69:11400:x1870627074016128:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783969343.640357:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+69:11400:x1870627074016128:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 120us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.640367:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:0.0:1783969343.653524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.656077:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074016256 00000100:00100000:3.0:1783969343.656094:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074016256 00000100:00100000:3.0:1783969343.656196:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:3.0:1783969343.656207:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+10:11400:x1870627074016256:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969343.656227:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969343.656250:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039ba expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.656283:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039b3 expref: 11 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.656292:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969343.656296:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969343.656301:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.656337:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039b3 expref: 11 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.656350:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039b3 expref: 11 pid: 9974 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969343.656363:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1870627099257088:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969343.656522:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9822356c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969343.668900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.668938:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1870627099257088:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969343.668976:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.669011:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53800, rc 0) 00000100:00100000:0.0:1783969343.669017:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074016384 00000100:00100000:0.0:1783969343.669034:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074016384 00010000:00010000:0.0:1783969343.669070:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039b3 expref: 12 pid: 9974 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969343.669092:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+12:11400:x1870627074016256:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 12884us (15576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.669115:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:0.0:1783969343.669119:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:0.0:1783969343.669131:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2118850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+12:2392:x1870627074016384:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969343.669146:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969343.669175:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039b3 expref: 11 pid: 9974 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.669189:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039b3 expref: 11 pid: 9974 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.669213:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cba419 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039b3 expref: 11 pid: 9974 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.669226:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969343.669231:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969343.669239:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.669250:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.669283:0:7929:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969343.669298:0:7929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e03480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7929:1870627099257216:192.168.201.34@tcp:105: 00000100:00100000:0.0:1783969343.669351:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969343.679790:0:7929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e03480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7929:1870627099257216:192.168.201.34@tcp:105: 00010000:00010000:0.0:1783969343.679825:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969343.679903:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2118850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2392:x1870627074016384:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 10775us (11013us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.679931:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:2.0:1783969343.686850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.687096:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074016512 00000100:00100000:3.0:1783969343.687115:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074016512 00002000:00100000:3.0:1783969343.687316:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93e9837c3b80 x1870627074016512/t0(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:239/0 lens 504/0 e 0 to 0 dl 1783969354 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969343.687327:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93e9837c3b80 with x1870627074016512 ext(0->12) 00002000:00010000:3.0:1783969343.687333:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93e9837c3b80 00000100:00100000:3.0:1783969343.687374:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1783969343.687435:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2391:x1870627074016512:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783969343.690586:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+12:2391:x1870627074016512:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 3151us (3735us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783969343.690853:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00002000:00100000:2.0:1783969343.690868:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93e9837c3b80 x1870627074016512/t4294967309(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:239/0 lens 504/448 e 0 to 0 dl 1783969354 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969343.690879:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93e9837c3b80 with x1870627074016512 ext(0->12) 00002000:00010000:2.0:1783969343.690885:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93e9837c3b80 00000100:00100000:2.0:1783969343.696621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.696725:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074016640 00000100:00100000:3.0:1783969343.696735:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074016640 00000100:00100000:3.0:1783969343.696786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:3.0:1783969343.696793:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+69:11400:x1870627074016640:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783969343.704233:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:0.0:1783969343.704254:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1783969343.704300:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1783969343.704315:0:6500:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93e983419840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1783969343.704320:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab74ca900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93e9834199c0 00000020:00080000:0.0:1783969343.704324:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab74cad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93e983d6ac00 00000004:00080000:0.0:1783969343.704354:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1783969343.704402:0:6500:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93e982235480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1783969343.704406:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab7523b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93e982235b40 00000020:00080000:0.0:1783969343.704408:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab7523800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ea82e9ce00 00000020:00080000:0.0:1783969343.704432:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1783969343.704499:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783969343.704645:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11400:x1870627074016640:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 7845us (8039us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.704656:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:1.0:1783969343.705726:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099257600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783969343.705784:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969343.705850:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099257600 00000100:00100000:1.0:1783969343.705858:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099257600 00000100:00100000:1.0:1783969343.705998:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783969343.706008:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3648:x1870627099257600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783969343.706048:0:9974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1783969343.706082:0:9974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a55363d, atime: 0x6a55363d, ctime: 0x6a55363d, blocks: 0x8 00010000:00010000:1.0:1783969343.706090:0:9974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.706292:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1783969343.706297:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969343.706304:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.706411:0:9974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.706437:0:9974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.706446:0:9974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.706468:0:9974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783969343.706598:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099257472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783969343.706656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969343.706688:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969343.706694:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099257344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783969343.706718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969343.708256:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969343.708269:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.708282:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969343.708287:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.708296:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.708338:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.708346:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afa81da2/0xea31253a47cba427 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.708373:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969343.708375:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969343.708377:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969343.708423:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099257472 00000100:00100000:0.0:1783969343.708432:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099257472 00000100:00100000:0.0:1783969343.708477:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099257344 00000100:00100000:0.0:1783969343.708481:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099257344 00000100:00100000:0.0:1783969343.708495:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783969343.708501:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1870627099257472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783969343.708838:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3648:x1870627099257600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2830us (3052us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783969343.708847:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783969343.708866:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783969343.708873:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3647:x1870627099257344:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1783969343.709219:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93e983c75880/2, rc 0, transno 4294967305 00000100:00100000:1.0:1783969343.709226:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099257600:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783969343.709785:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709798:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709806:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709825:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.709829:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709835:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709849:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93ea98408d00) 00010000:00010000:3.0:1783969343.709852:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969343.709856:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709862:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba125 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709896:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709901:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709907:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709911:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.709913:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709918:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709935:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93ea911e6400) 00010000:00010000:3.0:1783969343.709937:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969343.709940:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709945:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba1cd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709960:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709966:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709971:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709976:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.709978:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709984:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.709991:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982253700) 00010000:00010000:3.0:1783969343.709993:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969343.709996:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710000:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba24b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710047:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710053:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710059:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710065:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.710068:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710074:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710083:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93e982253700) 00010000:00010000:3.0:1783969343.710085:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969343.710090:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710096:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba26e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710110:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710116:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710121:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710144:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.710149:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710154:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710163:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:3.0:1783969343.710165:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969343.710168:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710173:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba340 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710188:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710192:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710199:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710203:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.710206:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710211:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710226:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:3.0:1783969343.710228:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783969343.710231:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.710236:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba3fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783969343.710827:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969343.716654:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.719753:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1783969343.719778:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1783969343.720575:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074016768 00000100:00100000:2.0:1783969343.720587:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074016768 00000100:00100000:1.0:1783969343.720864:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:1.0:1783969343.720876:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+12:2391:x1870627074016768:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783969343.721987:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1783969343.722002:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00002000:00010000:0.0:1783969343.723101:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783969343.723109:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783969342 00002000:00010000:0.0:1783969343.723112:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783969343.723114:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1783969342 -> 1783969342 00002000:00010000:0.0:1783969343.723116:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00002000:00080000:1.0:1783969343.723291:0:9974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1783969343.723321:0:9974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.723366:0:9974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303912 expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.723375:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1783969343.723402:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783969343.723408:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.723443:0:9974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303912 expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.723460:0:9974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303912 expref: 12 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.723476:0:9974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9974:1870627099257728:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969343.723557:0:9974:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5a113c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969343.725042:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1870627099257472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 16533us (18379us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783969343.725057:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000001:00080000:2.0:1783969343.727327:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1783969343.727342:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000004:00080000:3.0:1783969343.730508:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93e983743100/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783969343.730524:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099257472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783969343.731868:0:9974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9974:1870627099257728:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969343.731914:0:9974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.732935:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074016768:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 12057us (16286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.732948:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1783969343.733586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.734246:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074016896 00000100:00100000:1.0:1783969343.734255:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074016896 00010000:00010000:1.0:1783969343.734289:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303912 expref: 7 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.734338:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:1.0:1783969343.734364:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074016896:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969343.734400:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969343.734407:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303912 expref: 7 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.738417:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303912 expref: 7 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.738554:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cba1db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303912 expref: 7 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.738574:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783969343.738579:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783969343.738585:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.738596:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.738741:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969343.738801:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627074016896:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4436us (5215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.738814:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00010000:00010000:3.0:1783969343.738904:0:9974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.738914:0:9974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.738926:0:9974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.738936:0:9974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.738985:0:9974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969343.739248:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969343.739255:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.739275:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2177600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969343.739280:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.739288:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.739302:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.739310:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba42e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.739331:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969343.739333:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969343.739335:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969343.739645:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099257344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30770us (32923us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783969343.739655:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783969343.739716:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1783969343.739723:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1783969343.739747:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93e983743100, transno 4294967310 00000100:00100000:0.0:1783969343.739769:0:3647:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff93e983741880 x1870627099257344/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783969359 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783969343.739780:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93e983741880/2, rc 0, transno 4294967311 00000100:00100000:0.0:1783969343.739786:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099257344:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783969343.747297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.747454:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074017152 00000100:00100000:3.0:1783969343.747465:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074017152 00000100:00100000:3.0:1783969343.747526:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:3.0:1783969343.747537:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11400:x1870627074017152:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969343.747594:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969343.749244:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba412 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ac expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.749269:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:3.0:1783969343.749273:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969343.749308:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.749323:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.749332:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969343.749481:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000268e5a15 reply state 00000000bac1835a transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.749494:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.749514:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:3.0:1783969343.749516:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969343.749520:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969343.749683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+17:11400:x1870627074017152:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 2147us (2394us total) trans 4294967404 rc 0/0 00000100:00100000:3.0:1783969343.749692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:2.0:1783969343.761345:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969343.761412:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074017280 00000100:00100000:2.0:1783969343.761425:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074017280 00000100:00100000:2.0:1783969343.761490:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1783969343.761499:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627074017280:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783969343.762437:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1783969343.762444:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1783969342 -> 1783969342 00002000:00010000:2.0:1783969343.762446:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783969341 00002000:00010000:2.0:1783969343.762448:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1783969342 -> 1783969342 00002000:00010000:2.0:1783969343.762450:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783969343.762517:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074017280:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 1017us (1181us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783969343.762526:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1783969343.768129:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.768258:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074017536 00000100:00100000:3.0:1783969343.768268:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074017536 00000100:00100000:3.0:1783969343.768336:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:3.0:1783969343.768347:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+17:11400:x1870627074017536:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783969343.768456:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.768476:0:7749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630399e expref: 17 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.768486:0:7749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.768522:0:7749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630399e expref: 17 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.768535:0:7749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630399e expref: 17 pid: 13769 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969343.768551:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099257856:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969343.768637:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969343.775759:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.775875:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074017664 00000100:00100000:1.0:1783969343.775891:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074017664 00010000:00010000:1.0:1783969343.775928:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630399e expref: 18 pid: 13769 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.775958:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:1.0:1783969343.775965:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+18:2391:x1870627074017664:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969343.775977:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969343.775983:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630399e expref: 18 pid: 13769 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.776004:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630399e expref: 18 pid: 13769 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.776035:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:1.0:1783969343.776040:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.776050:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.776061:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.776080:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969343.776331:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+18:2391:x1870627074017664:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 364us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.776340:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00010000:00010000:3.0:1783969343.776964:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba3f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d35630399e expref: 17 pid: 13769 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969343.777002:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099257856:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969343.777044:0:7749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.777053:0:7749:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.777058:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.777100:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.777215:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.777223:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.777229:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969343.777233:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.777240:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.777252:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:3.0:1783969343.777255:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783969343.777268:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.777274:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba43c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969343.777445:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11400:x1870627074017536:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 9099us (9341us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783969343.777455:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:0.0:1783969343.788685:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.788797:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074017792 00000100:00100000:1.0:1783969343.788807:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074017792 00000100:00100000:1.0:1783969343.788868:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:1.0:1783969343.788878:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074017792:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783969343.788929:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.788951:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.788980:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969343.788984:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783969343.788989:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.789037:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.789053:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 7 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.789070:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1870627099257984:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969343.789223:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5a113c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969343.797455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969343.798943:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074017920 00000100:00100000:3.0:1783969343.798959:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074017920 00010000:00010000:3.0:1783969343.799043:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 8 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969343.799098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:3.0:1783969343.799108:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074017920:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969343.799126:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969343.799150:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 8 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.799166:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 8 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.799193:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969343.799198:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969343.799204:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.799236:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.799259:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969343.799506:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074017920:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 398us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.799515:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00010000:00010000:1.0:1783969343.803931:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a88d18e/0xea31253a47cba420 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039ba expref: 7 pid: 8439 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.803958:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1870627099257984:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969343.803987:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.804001:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.804008:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.804071:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.804080:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.804088:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.804095:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2177600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969343.804101:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.804110:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.804133:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.804141:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007380d9a4/0xea31253a47cba443 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.804235:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2391:x1870627074017792:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 15357us (15558us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.804245:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1783969343.812226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.812308:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074018176 00000100:00100000:1.0:1783969343.812320:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074018176 00000100:00100000:1.0:1783969343.812420:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:1.0:1783969343.812430:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+16:11400:x1870627074018176:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783969343.812511:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.812528:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303966 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.812538:0:13769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.812576:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303966 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.812590:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303966 expref: 16 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.812605:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099258112:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969343.812696:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5a113c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969343.820061:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099258112:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969343.820094:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969343.821280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.821783:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074018304 00000100:00100000:1.0:1783969343.821792:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074018304 00010000:00010000:1.0:1783969343.821832:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303966 expref: 17 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.821887:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:1.0:1783969343.821897:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+17:2391:x1870627074018304:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969343.821915:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969343.821923:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303966 expref: 17 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.821936:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303966 expref: 17 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.821961:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba339 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303966 expref: 17 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.821977:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:1.0:1783969343.821983:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303989 expref: 16 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.821994:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.822002:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.822009:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.822052:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969343.822114:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+16:2391:x1870627074018304:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 217us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.822258:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00010000:00010000:2.0:1783969343.822894:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.822903:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.823146:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.823160:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039a5 expref: 16 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.823168:0:13769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.823201:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039a5 expref: 16 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.823216:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039a5 expref: 16 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969343.823231:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099258240:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969343.823352:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824cf240 going to sleep for 11 seconds 00000100:00100000:1.0:1783969343.834572:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099258240:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969343.834608:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969343.834780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.834860:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074018432 00000100:00100000:1.0:1783969343.834868:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074018432 00010000:00010000:1.0:1783969343.834904:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039a5 expref: 17 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.834944:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:1.0:1783969343.834953:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+17:2391:x1870627074018432:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969343.834969:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969343.834977:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039a5 expref: 17 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.834989:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039a5 expref: 17 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.835012:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba404 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039a5 expref: 17 pid: 9027 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.835040:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:1.0:1783969343.835045:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.835057:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.835079:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.835106:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969343.835177:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+16:2391:x1870627074018432:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 223us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.835185:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00010000:00010000:2.0:1783969343.836295:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.836306:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969343.836464:0:13769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1783969343.836597:0:13769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1783969343.836636:0:13769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1783969343.836745:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13769:1870627099258368:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783969343.836814:0:13769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969343.836852:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824cf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969343.837494:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099258368 00000100:00100000:0.0:1783969343.837502:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099258368 00000100:00100000:0.0:1783969343.837564:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783969343.837574:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13769:x1870627099258368:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783969343.837904:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13769:x1870627099258368:12345-0@lo:1000:mdt00_005.0 Request processed in 331us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.837911:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783969343.839756:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13769:1870627099258368:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1783969343.839921:0:13769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:2.0:1783969343.839997:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13769:1870627099258496:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783969343.840069:0:13769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969343.840111:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824cf300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969343.840920:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099258496 00000100:00100000:0.0:1783969343.840928:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099258496 00000100:00100000:0.0:1783969343.840984:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783969343.840994:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13769:x1870627099258496:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783969343.841173:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13769:x1870627099258496:12345-0@lo:1000:mdt00_005.0 Request processed in 180us (1103us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1783969343.841181:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783969343.841262:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13769:1870627099258496:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1783969343.841319:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841330:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841338:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841344:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969343.841349:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841356:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841374:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:2.0:1783969343.841377:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969343.841429:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841436:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba451 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841462:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841468:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841475:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841480:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969343.841483:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841489:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841497:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:2.0:1783969343.841500:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969343.841507:0:13769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303989 expref: 19 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841520:0:13769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303989 expref: 19 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841529:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303989 expref: 19 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.841570:0:13769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303989 expref: 19 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969343.841582:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983609880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099258624:192.168.201.34@tcp:105: 00000100:00100000:2.0:1783969343.841654:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9824cf300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969343.846038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.846170:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983609880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099258624:192.168.201.34@tcp:105: 00010000:00010000:1.0:1783969343.846201:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846211:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba394 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846245:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846257:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846269:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846280:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846286:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846293:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846329:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969343.846335:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846342:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846353:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:1.0:1783969343.846356:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969343.846360:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846365:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba458 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846429:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846435:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846440:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846444:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969343.846446:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846451:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846468:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:1.0:1783969343.846470:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783969343.846473:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969343.846477:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba44a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969343.846638:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11400:x1870627074018176:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 34209us (34422us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1783969343.846649:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 139 00000020:00080000:1.0:1783969343.846657:0:13769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783969343.847266:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074018560 00000100:00100000:3.0:1783969343.847276:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074018560 00000100:00100000:3.0:1783969343.847336:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:3.0:1783969343.847345:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11399:x1870627074018560:12345-192.168.201.34@tcp:49:lfs.0 00000100:00100000:3.0:1783969343.847491:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11399:x1870627074018560:12345-192.168.201.34@tcp:49:lfs.0 Request processed in 147us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.847498:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000040:00080000:2.0:1783969343.847833:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783969343.847839:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783969343.850001:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783969343.850028:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783969343.853781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969343.853833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.853908:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074018816 00000100:00100000:0.0:1783969343.853919:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074018816 00000100:00100000:0.0:1783969343.853988:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:0.0:1783969343.853998:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11399:x1870627074018816:12345-192.168.201.34@tcp:58:lfs.0 00000040:00080000:0.0:1783969343.854243:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1783969343.854340:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11399:x1870627074018816:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 342us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.854349:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:3.0:1783969343.857503:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074019072 00000100:00100000:3.0:1783969343.857521:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074019072 00000100:00100000:3.0:1783969343.857598:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:3.0:1783969343.857609:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+19:11400:x1870627074019072:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783969343.857941:0:6525:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783969343.857977:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:3.0:1783969343.858029:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.858046:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.858078:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.859302:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.859327:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.859333:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969343.859354:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783969343.859505:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+21:11400:x1870627074019072:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1895us (5668us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1783969343.859516:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000020:00080000:3.0:1783969343.859521:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783969343.861894:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969343.861910:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.861922:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969343.861926:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.861935:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.861955:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:0.0:1783969343.861958:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783969343.861962:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.861968:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba45f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.861987:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969343.861989:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969343.861991:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969343.912767:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.913098:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074019200 00000100:00100000:0.0:1783969343.913126:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074019200 00000100:00100000:0.0:1783969343.913202:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:0.0:1783969343.913215:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+21:11402:x1870627074019200:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969343.913258:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969343.913281:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba466 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039c1 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913377:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913425:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913438:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913453:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913460:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913466:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913563:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913574:0:9027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303982 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913583:0:9027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913622:0:9027:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303982 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.913642:0:9027:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303982 expref: 22 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969343.913658:0:9027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e01880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099258752:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969343.913761:0:9027:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419480 going to sleep for 11 seconds 00000100:00100000:2.0:1783969343.917689:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969343.917850:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074019456 00000100:00100000:1.0:1783969343.917861:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074019456 00000100:00100000:1.0:1783969343.917926:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:1.0:1783969343.917937:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+23:6163:x1870627074019456:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783969343.918223:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+24:6163:x1870627074019456:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 286us (545us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1783969343.918232:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:0.0:1783969343.918984:0:9027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e01880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099258752:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969343.919012:0:9027:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969343.924911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969343.925029:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074019584 00000100:00100000:0.0:1783969343.925041:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074019584 00010000:00010000:0.0:1783969343.925081:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303982 expref: 24 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969343.925134:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:0.0:1783969343.925145:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+24:2392:x1870627074019584:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969343.925161:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969343.925168:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303982 expref: 24 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.925181:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303982 expref: 24 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.925204:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba386 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303982 expref: 24 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.925241:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:0.0:1783969343.925246:0:7929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.925255:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.925263:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969343.925300:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969343.925363:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+23:2392:x1870627074019584:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 220us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969343.925371:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00010000:00010000:2.0:1783969343.925499:0:9027:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925507:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969343.925558:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783969343.925563:0:9027:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969343.925583:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925597:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925618:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925625:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925632:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925637:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969343.925642:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925649:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925659:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969343.925662:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969343.925665:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925671:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba46d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925682:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925689:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925694:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925705:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969343.925709:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925714:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925723:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93ea98408e00) 00010000:00010000:2.0:1783969343.925726:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969343.925728:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925733:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba474 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925768:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba466 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039c1 expref: 23 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925781:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039c1 expref: 22 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969343.925789:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:2.0:1783969343.925791:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969343.925793:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796c00, rc 0) 00000100:00100000:2.0:1783969343.925818:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11402:x1870627074019200:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 12606us (13068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969343.925824:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 141 00010000:00010000:3.0:1783969344.306030:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969344.372074:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969344.372109:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099258880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969344.372354:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969344.372493:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099258880 00000100:00100000:2.0:1783969344.372517:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099258880 00000100:00100000:2.0:1783969344.372570:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783969344.372579:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099258880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783969344.372612:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1783969344.372657:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099258880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969344.372664:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783969344.372922:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099258880:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1783969344.828371:0:14281:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969344.828394:0:14281:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969344.830561:0:14281:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783969344.830572:0:14281:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783969344.881570:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783969344.881580:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783969344.881619:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783969344.881626:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783969344.881788:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf7fb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099259008:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783969344.881882:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0000 going to sleep for 11 seconds 00000100:00100000:3.0:1783969344.887216:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969344.887243:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099259136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969344.887324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969344.887680:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099259136 00000100:00100000:1.0:1783969344.887688:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099259136 00000100:00100000:1.0:1783969344.887751:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783969344.887763:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099259136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969344.887800:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969344.887854:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099259136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969344.887863:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783969344.887930:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099259136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969344.891076:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf7fb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099259008:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783969344.901866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969344.901905:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074019712 00000100:00100000:3.0:1783969344.901913:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074019712 00000100:00100000:3.0:1783969344.902019:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 142 00000100:00100000:3.0:1783969344.902036:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11414:x1870627074019712:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783969344.902071:0:6522:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783969344.902186:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11414:x1870627074019712:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 150us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969344.902194:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 142 00000100:00100000:2.0:1783969344.921160:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969344.926372:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074019968 00000100:00100000:2.0:1783969344.928085:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074019968 00000100:00100000:2.0:1783969344.928176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:2.0:1783969344.928188:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+22:11414:x1870627074019968:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969344.928209:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969344.928230:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba482 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039c8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969344.928343:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba489 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969344.928361:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba489 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969344.928375:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba489 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969344.928413:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783969344.928525:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba482 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039c8 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969344.928543:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba489 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039c8 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969344.928552:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:2.0:1783969344.928555:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969344.928559:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae200, rc 0) 00000100:00100000:2.0:1783969344.928632:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+24:11414:x1870627074019968:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 446us (7482us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1783969344.928640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:0.0:1783969344.939602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969344.939698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969344.939787:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074020096 00000100:00100000:1.0:1783969344.939796:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074020096 00000100:00100000:1.0:1783969344.939859:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1783969344.939868:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab211b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+24:2392:x1870627074020096:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969344.939885:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969344.939912:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae200/0xea31253a47cba489 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039c8 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969344.939929:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:1.0:1783969344.939935:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969344.939996:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab211b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+23:2392:x1870627074020096:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 128us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969344.940024:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1783969344.944722:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074020352 00000100:00100000:3.0:1783969344.944739:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074020352 00000100:00100000:3.0:1783969344.944819:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:3.0:1783969344.944829:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+23:11414:x1870627074020352:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783969344.944908:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969344.944926:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969344.944937:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969344.945105:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969344.945114:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969344.945120:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969344.945126:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969344.945130:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969344.945149:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969344.945171:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:3.0:1783969344.945175:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783969344.945180:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969344.945186:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba497 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969344.945312:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+24:11414:x1870627074020352:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 484us (5612us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1783969344.945321:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 144 00000040:00080000:3.0:1783969344.945544:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969344.945549:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969344.946069:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783969344.946079:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783969344.959885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969344.959957:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074020608 00000100:00100000:3.0:1783969344.959967:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074020608 00000100:00100000:3.0:1783969344.960030:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1783969344.960040:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+24:11414:x1870627074020608:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783969344.960290:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+25:11414:x1870627074020608:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 250us (415us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1783969344.960298:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00010000:00010000:1.0:1783969345.328634:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969345.392642:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099259264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969345.392741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969345.392838:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099259264 00000100:00100000:0.0:1783969345.392847:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099259264 00000100:00100000:0.0:1783969345.392915:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783969345.392926:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1870627099259264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969345.392961:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783969345.393029:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1870627099259264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969345.393056:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783969345.393084:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099259648:0@lo:400:kworker.0 00000100:00100000:0.0:1783969345.393114:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099259520:0@lo:400:kworker.0 00000100:00100000:2.0:1783969345.393124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969345.393149:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099260160:0@lo:400:kworker.0 00000100:00100000:0.0:1783969345.393164:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969345.393178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969345.393199:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099260032:0@lo:400:kworker.0 00000100:00100000:2.0:1783969345.393202:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099260672:0@lo:400:kworker.0 00000100:00100000:0.0:1783969345.393238:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969345.393263:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099259648 00000100:00100000:2.0:1783969345.393269:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099259648 00000100:00100000:0.0:1783969345.393273:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099260544:0@lo:400:kworker.0 00000100:00100000:0.0:1783969345.393304:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783969345.393362:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969345.393405:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099259776:0@lo:400:kworker.0 00000100:00100000:3.0:1783969345.393469:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099259392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969345.393561:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099259520 00000100:00100000:0.0:1783969345.393565:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099259520 00000100:00100000:0.0:1783969345.393595:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1783969345.393602:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099259520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.394407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969345.394439:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab7414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099260288:0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.394473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969345.394494:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099260800:0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.394544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969345.394569:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099260160 00000100:00100000:2.0:1783969345.394577:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099260160 00000100:00100000:1.0:1783969345.394598:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099259264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969345.394625:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099260032 00000100:00100000:2.0:1783969345.394629:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099260032 00000100:00100000:1.0:1783969345.394639:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099259776 00000100:00100000:1.0:1783969345.394645:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099259776 00000100:00100000:2.0:1783969345.394648:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099260544 00000100:00100000:2.0:1783969345.394653:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099260544 00000100:00100000:1.0:1783969345.394683:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783969345.394691:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1783969345.394696:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099259776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.394743:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099259776:12345-0@lo:400:kworker.0 Request processed in 52us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969345.394751:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783969345.394775:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099260288 00000100:00100000:1.0:1783969345.394779:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099260288 00000100:00100000:1.0:1783969345.394806:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099260800 00000100:00100000:1.0:1783969345.394809:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099260800 00000100:00100000:1.0:1783969345.394834:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783969345.394839:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099260288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.394867:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099260288:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969345.394873:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783969345.394885:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783969345.394890:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099260800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.394915:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099260800:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969345.394921:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783969345.395006:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099259648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.395016:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1783969345.395026:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099260160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969345.395055:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099259648:12345-0@lo:400:kworker.0 Request processed in 52us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969345.395063:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783969345.395080:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1783969345.395087:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099260032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.395213:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099260160:12345-0@lo:400:kworker.0 Request processed in 189us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969345.395226:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1783969345.395241:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1783969345.395246:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099260544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.395281:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099260544:12345-0@lo:400:kworker.0 Request processed in 35us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969345.395286:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:1.0:1783969345.395313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969345.395317:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969345.395320:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969345.395322:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969345.395341:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099259776:0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.395351:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab7414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099260288:0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.395359:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099260800:0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.395443:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099260544:0@lo:400:kworker.0 00000100:00100000:2.0:1783969345.395524:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099260032:12345-0@lo:400:kworker.0 Request processed in 436us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969345.395532:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1783969345.395566:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099260032:0@lo:400:kworker.0 00000100:00100000:2.0:1783969345.395630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969345.395668:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099259648:0@lo:400:kworker.0 00010000:00080000:2.0:1783969345.395685:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9836ff100 x1870627099260160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969345.395696:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099260672 00000100:00100000:1.0:1783969345.395703:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099260672 00000100:00100000:1.0:1783969345.395735:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1783969345.395741:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099260672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.395776:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099260672:12345-0@lo:400:kworker.0 Request processed in 35us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969345.395781:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:1.0:1783969345.395796:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969345.395921:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969345.395932:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099260160:0@lo:400:kworker.0 00010000:00080000:2.0:1783969345.395952:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea85f95f80 x1870627099260672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969345.395962:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099260672:0@lo:400:kworker.0 00000100:00100000:3.0:1783969345.395966:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099259904:0@lo:400:kworker.0 00000100:00100000:3.0:1783969345.396010:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969345.396030:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099260416:0@lo:400:kworker.0 00000100:00100000:3.0:1783969345.396051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969345.396642:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099259904 00000100:00100000:2.0:1783969345.396649:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099259904 00000100:00100000:2.0:1783969345.396707:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1783969345.396716:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099259904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969345.396730:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099259392 00000100:00100000:1.0:1783969345.396736:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099259392 00000100:00100000:1.0:1783969345.396771:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783969345.396776:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099259904:12345-0@lo:400:kworker.0 Request processed in 61us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969345.396790:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaba0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099259392:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969345.396797:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00002000:00000024:1.0:1783969345.396811:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783969345.396853:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaba0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099259392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969345.396860:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099260416 00000100:00100000:1.0:1783969345.396861:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783969345.396866:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099260416 00000100:00100000:2.0:1783969345.396903:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783969345.396911:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099260416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969345.396952:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099260416:12345-0@lo:400:kworker.0 Request processed in 42us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969345.396959:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1783969345.397257:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969345.397426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099259520:12345-0@lo:400:kworker.0 Request processed in 3821us (4259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969345.397437:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1783969345.397615:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099259520:0@lo:400:kworker.0 00000100:00100000:3.0:1783969345.397848:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099259392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969345.397863:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099259904:0@lo:400:kworker.0 00000100:00100000:3.0:1783969345.397873:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1783969345.397879:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1783969345.397894:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93eabf92b800, transno 4294967302 00000004:00080000:3.0:1783969345.397969:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1783969345.397983:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93e983c75880, transno 4294967305 00000100:00100000:3.0:1783969345.397988:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099260416:0@lo:400:kworker.0 00000100:00100000:3.0:1783969345.905019:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099260928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969345.905088:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969345.905215:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099260928 00000100:00100000:2.0:1783969345.905224:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099260928 00000100:00100000:2.0:1783969345.905284:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783969345.905293:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099260928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969345.905327:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969345.905376:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099260928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969345.905432:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783969345.905433:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099260928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969345.905457:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969345.905465:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099261056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969345.905494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969345.905673:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099261056 00000100:00100000:0.0:1783969345.905677:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099261056 00000100:00100000:0.0:1783969345.905713:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783969345.905720:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099261056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969345.905731:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969345.905763:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099261056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969345.905769:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783969345.905802:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099261056:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783969346.352790:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783969346.995102:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969346.995115:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969346.995140:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783969346.995148:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1783969347.073805:0:14332:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969347.073819:0:14332:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969347.073857:0:14332:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783969347.073865:0:14332:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969347.263578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969347.271953:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074020864 00000100:00100000:1.0:1783969347.271977:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074020864 00000100:00100000:1.0:1783969347.272061:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:1.0:1783969347.272072:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+25:11434:x1870627074020864:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969347.272100:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969347.272122:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba49e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039cf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969347.272238:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba4a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969347.272255:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba4a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969347.272291:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba4a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969347.272305:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783969347.272454:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba49e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039cf expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969347.272474:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba4a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039cf expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969347.272483:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:1.0:1783969347.272486:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783969347.272490:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2176a00, rc 0) 00000100:00100000:1.0:1783969347.272558:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+27:11434:x1870627074020864:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 489us (8992us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1783969347.272566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00080000:2.0:1783969347.272682:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1783969347.275097:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783969347.283121:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969347.283339:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074020992 00000100:00100000:3.0:1783969347.283350:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074020992 00000100:00100000:3.0:1783969347.283432:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:3.0:1783969347.283442:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+27:11434:x1870627074020992:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:3.0:1783969347.283517:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969347.283548:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969347.283561:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969347.283601:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969347.283609:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969347.283616:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969347.283622:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969347.283627:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969347.283634:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969347.283646:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:3.0:1783969347.283648:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969347.283653:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969347.283659:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969347.283724:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+27:11434:x1870627074020992:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 283us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969347.283736:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:1.0:1783969347.344272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969347.344321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969347.344607:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074021376 00000100:00100000:3.0:1783969347.344617:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074021376 00000100:00100000:3.0:1783969347.344682:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:3.0:1783969347.344693:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074021376:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969347.344723:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074021120 00000100:00100000:0.0:1783969347.344727:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074021120 00000100:00100000:0.0:1783969347.344756:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 395 00000100:00100000:3.0:1783969347.344763:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074021376:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 73us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969347.344763:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627074021120:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969347.344771:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:0.0:1783969347.344789:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627074021120:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00080000:3.0:1783969347.344793:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969347.344795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 395 00000100:00100000:1.0:1783969347.345319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969347.345377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969347.345598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969347.345623:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969347.347195:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074021504 00000100:00100000:2.0:1783969347.347208:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074021504 00000100:00100000:2.0:1783969347.347280:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:2.0:1783969347.347289:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074021504:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969347.347357:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074021504:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 70us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969347.347364:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00080000:2.0:1783969347.347449:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969347.358818:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074021632 00000100:00100000:0.0:1783969347.358834:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074021632 00000100:00100000:3.0:1783969347.359402:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074021248 00000100:00100000:3.0:1783969347.363534:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074021248 00000100:00100000:3.0:1783969347.364156:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074021760 00000100:00100000:3.0:1783969347.364163:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074021760 00000100:00100000:3.0:1783969347.364202:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 327 00000100:00100000:3.0:1783969347.364212:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074021632:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969347.364315:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074021632:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 104us (19954us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969347.364323:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 327 00000100:00100000:3.0:1783969347.364343:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 328 00000100:00100000:3.0:1783969347.364348:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074021760:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969347.364398:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074021760:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 30us (18755us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969347.364405:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 328 00000100:00080000:0.0:1783969347.364509:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969347.364513:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969347.367708:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 329 00000100:00100000:2.0:1783969347.367723:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074021248:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969347.367814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074021248:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 94us (22437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969347.367822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 329 00000100:00080000:0.0:1783969347.367913:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783969347.381239:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969347.451349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969347.451798:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074021888 00000100:00100000:2.0:1783969347.451809:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074021888 00000100:00100000:2.0:1783969347.451923:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:2.0:1783969347.451936:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2393:x1870627074021888:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1783969347.451955:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969347.451985:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015280cca/0xea31253a47cba4ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039d6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969347.452011:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a55363e, atime: 0x6a55363d, ctime: 0x6a55363e, blocks: 0x8 00010000:00010000:2.0:1783969347.452042:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1783969347.452110:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969347.452121:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015280cca/0xea31253a47cba4ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039d6 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969347.452143:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015280cca/0xea31253a47cba4ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039d6 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969347.452157:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83daf200, rc 0) 00000100:00100000:2.0:1783969347.452308:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074021888:12345-192.168.201.34@tcp:101:cat.0 Request processed in 374us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969347.452332:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1783969347.457915:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969347.458015:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074022016 00000100:00100000:3.0:1783969347.458028:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074022016 00002000:00100000:3.0:1783969347.458100:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93eab779ca80 x1870627074022016/t0(0) o3->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:243/0 lens 488/0 e 0 to 0 dl 1783969358 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969347.458112:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab779ca80 with x1870627074022016 ext(0->4095) 00002000:00010000:3.0:1783969347.458117:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93eab779ca80 00000100:00100000:3.0:1783969347.458151:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:3.0:1783969347.458160:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2394:x1870627074022016:12345-192.168.201.34@tcp:3:cat.0 00000100:00100000:3.0:1783969347.458598:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2394:x1870627074022016:12345-192.168.201.34@tcp:3:cat.0 Request processed in 437us (692us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1783969347.458607:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00002000:00100000:3.0:1783969347.458614:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93eab779ca80 x1870627074022016/t0(0) o3->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:243/0 lens 488/4536 e 0 to 0 dl 1783969358 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969347.458622:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab779ca80 with x1870627074022016 ext(0->4095) 00002000:00010000:3.0:1783969347.458626:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93eab779ca80 00010000:00010000:1.0:1783969348.406140:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969349.424901:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969349.501759:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099261184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969349.501866:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969349.501973:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099261184 00000100:00100000:1.0:1783969349.501983:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099261184 00000100:00100000:1.0:1783969349.502788:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783969349.502804:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099261184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969349.502863:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783969349.502958:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099261184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969349.502966:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783969349.503249:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099261184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969350.000701:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969350.000734:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099261312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969350.000846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969350.001100:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099261312 00000100:00100000:1.0:1783969350.001111:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099261312 00000100:00100000:1.0:1783969350.001208:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783969350.001220:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099261312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969350.001269:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969350.001334:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099261312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969350.001342:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783969350.002857:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099261312:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1783969350.015257:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1783969350.015294:0:6500:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93e9824cf9c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1783969350.015300:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab7459a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93e9824cf240 00000020:00080000:2.0:1783969350.015303:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab7459e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ea90947c00 00000020:00080000:2.0:1783969350.015323:0:6500:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1783969350.015423:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969350.015434:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969350.015441:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969350.015447:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969350.015452:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969350.015459:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969350.015493:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93e982253c00) 00010000:00010000:0.0:1783969350.015496:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969350.015501:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969350.015508:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba435 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783969350.015538:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1783969350.015603:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1783969350.018714:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1783969350.018729:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1783969350.448684:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969350.513074:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099261824:0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.513149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969350.513205:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099262336:0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.513233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969350.513255:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099262848:0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.513276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969350.513315:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783969350.513322:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099261696:0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.513346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969350.513363:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099262208:0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.513403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969350.513418:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099262720:0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.513451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969350.513484:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099261824 00000100:00100000:1.0:1783969350.513492:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099261824 00000100:00100000:1.0:1783969350.513532:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1783969350.513540:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099261824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.513602:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099261824:12345-0@lo:400:kworker.0 Request processed in 62us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969350.513610:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1783969350.513632:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099262336 00000100:00100000:1.0:1783969350.513635:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099262336 00000100:00100000:1.0:1783969350.513662:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099262848 00000100:00100000:0.0:1783969350.513868:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099261440:0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.513922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969350.513949:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099261952:0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.513971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969350.513985:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099262464:0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514007:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969350.514023:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783969350.514028:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98362bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099261568:0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969350.514061:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099262080:0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514081:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969350.514097:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099262592:0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783969350.514143:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969350.514155:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099261440 00000100:00100000:0.0:1783969350.514166:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099261440 00000100:00100000:0.0:1783969350.514194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1783969350.514200:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099261440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514235:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3648:x1870627099261440:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969350.514241:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1783969350.514274:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099261952 00000100:00100000:0.0:1783969350.514277:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099261952 00000100:00100000:0.0:1783969350.514299:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099262464 00000100:00100000:0.0:1783969350.514301:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099262464 00000100:00100000:0.0:1783969350.514312:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099261568 00000100:00100000:0.0:1783969350.514314:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099261568 00000100:00100000:0.0:1783969350.514325:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099262080 00000100:00100000:0.0:1783969350.514326:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099262080 00000100:00100000:0.0:1783969350.514338:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099262592 00000100:00100000:0.0:1783969350.514340:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099262592 00000100:00100000:0.0:1783969350.514353:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783969350.514358:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099261952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514406:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099261952:12345-0@lo:400:kworker.0 Request processed in 47us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969350.514413:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783969350.514424:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1783969350.514430:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099262464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514456:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099262464:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969350.514462:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1783969350.514472:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1783969350.514478:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099261568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514514:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099261568:12345-0@lo:400:kworker.0 Request processed in 37us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969350.514520:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1783969350.514534:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1783969350.514539:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099262080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514563:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099262080:12345-0@lo:400:kworker.0 Request processed in 23us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969350.514568:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1783969350.514577:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1783969350.514583:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099262592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.514608:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099262592:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969350.514614:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:0.0:1783969350.514633:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969350.514635:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969350.514762:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099262848 00000100:00100000:1.0:1783969350.514789:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099262208 00000100:00100000:1.0:1783969350.514792:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099262208 00000100:00100000:1.0:1783969350.514806:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099262720 00000100:00100000:1.0:1783969350.514809:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099262720 00000100:00100000:1.0:1783969350.514823:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783969350.514829:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099262336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.514862:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099262336:12345-0@lo:400:kworker.0 Request processed in 33us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969350.514868:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783969350.514878:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783969350.514891:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099262848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.514933:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099262848:12345-0@lo:400:kworker.0 Request processed in 43us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969350.514939:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783969350.514950:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783969350.514956:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099262208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.514981:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099262208:12345-0@lo:400:kworker.0 Request processed in 26us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969350.514987:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783969350.514995:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783969350.515001:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099262720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.515028:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099262720:12345-0@lo:400:kworker.0 Request processed in 28us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969350.515034:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783969350.515052:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099261696 00000100:00100000:1.0:1783969350.515056:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099261696 00000100:00100000:1.0:1783969350.515081:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783969350.515086:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099261696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969350.515118:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099261696:12345-0@lo:400:kworker.0 Request processed in 32us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969350.515125:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783969350.515344:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099261696:0@lo:400:kworker.0 00000100:00100000:2.0:1783969350.515356:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099262208:0@lo:400:kworker.0 00000100:00100000:2.0:1783969350.515366:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099262720:0@lo:400:kworker.0 00000100:00100000:2.0:1783969350.515393:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099261824:0@lo:400:kworker.0 00000100:00100000:2.0:1783969350.515405:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099262336:0@lo:400:kworker.0 00000100:00100000:2.0:1783969350.515415:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1783969350.515421:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93e983741880, transno 4294967311 00000004:00080000:2.0:1783969350.515431:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1783969350.515451:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099262848:0@lo:400:kworker.0 00000100:00080000:2.0:1783969350.515488:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969350.515492:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969350.515764:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98362bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099261568:0@lo:400:kworker.0 00010000:00080000:0.0:1783969350.515790:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983742680 x1870627099262080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969350.515800:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099262080:0@lo:400:kworker.0 00010000:00080000:0.0:1783969350.515812:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf92b800 x1870627099262592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969350.515820:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099262592:0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.515830:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099261440:0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.515855:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099261952:0@lo:400:kworker.0 00000100:00100000:0.0:1783969350.515867:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099262464:0@lo:400:kworker.0 00000100:00100000:3.0:1783969350.516210:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969350.516220:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099262976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969350.516262:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969350.516296:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099262976 00000100:00100000:3.0:1783969350.516300:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099262976 00000100:00100000:3.0:1783969350.516331:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783969350.516338:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099262976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969350.516359:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783969350.516414:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099262976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969350.516421:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783969350.516466:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099262976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969350.525629:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969350.525659:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099263104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969350.525755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969350.525824:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099263104 00000100:00100000:2.0:1783969350.525833:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099263104 00000100:00100000:2.0:1783969350.525904:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783969350.525923:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099263104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783969350.525966:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783969350.526030:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099263104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969350.526039:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783969350.526232:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099263104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969351.024779:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969351.024819:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099263232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969351.024931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969351.025004:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099263232 00000100:00100000:2.0:1783969351.025015:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099263232 00000100:00100000:0.0:1783969351.025236:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969351.025255:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9834f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099263360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969351.025320:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969351.027309:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099263360 00000100:00100000:2.0:1783969351.027322:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099263360 00000100:00100000:2.0:1783969351.027369:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783969351.027397:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099263232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969351.027438:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969351.027511:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099263232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969351.027519:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783969351.027537:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783969351.027543:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099263360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969351.027554:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969351.027582:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099263360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969351.027587:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783969351.028138:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9834f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099263360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783969351.028194:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099263232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783969351.473157:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969352.460569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969352.460670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969352.460730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969352.460764:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969352.460785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969352.460799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969352.460818:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969352.460846:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074022400 00000100:00100000:0.0:1783969352.460854:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074022400 00000100:00100000:0.0:1783969352.460917:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074022912 00000100:00100000:0.0:1783969352.460921:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074022912 00000100:00100000:0.0:1783969352.460938:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074022272 00000100:00100000:0.0:1783969352.460941:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074022272 00000100:00100000:0.0:1783969352.460952:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074022784 00000100:00100000:0.0:1783969352.460954:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074022784 00000100:00100000:0.0:1783969352.460984:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 336 00000100:00100000:0.0:1783969352.460995:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074022400:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969352.461073:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074022400:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 79us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969352.461081:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 336 00000100:00100000:0.0:1783969352.461098:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 337 00000100:00100000:0.0:1783969352.461104:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074022912:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969352.461145:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074022912:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 42us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969352.461151:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 337 00000100:00100000:0.0:1783969352.461164:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 338 00000100:00100000:0.0:1783969352.461170:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+13:2392:x1870627074022272:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969352.461193:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+13:2392:x1870627074022272:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969352.461199:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 338 00000100:00100000:0.0:1783969352.461210:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 339 00000100:00100000:0.0:1783969352.461216:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074022784:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969352.461237:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074022784:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969352.461243:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 339 00000100:00100000:2.0:1783969352.461921:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074022656 00000100:00100000:2.0:1783969352.461928:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074022656 00000100:00100000:2.0:1783969352.461975:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074022528 00000100:00100000:2.0:1783969352.461978:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074022528 00000100:00100000:2.0:1783969352.462010:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:2.0:1783969352.462019:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074022656:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969352.462064:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074022656:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 47us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969352.462079:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:2.0:1783969352.462096:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:2.0:1783969352.462103:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074022528:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969352.462128:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074022528:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969352.462134:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00080000:2.0:1783969352.462160:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969352.462165:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969352.462167:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969352.462169:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969352.465121:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074022144 00000100:00100000:1.0:1783969352.465136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074022144 00000100:00100000:1.0:1783969352.465211:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 397 00000100:00100000:1.0:1783969352.465222:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627074022144:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969352.465312:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627074022144:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 91us (4753us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969352.465321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 397 00010000:00010000:0.0:1783969352.498127:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969353.521463:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969354.173959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969354.174054:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074023040 00000100:00100000:0.0:1783969354.174067:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074023040 00000100:00100000:0.0:1783969354.174240:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:0.0:1783969354.174255:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+13:11087:x1870627074023040:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783969354.174437:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+13:11087:x1870627074023040:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 185us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969354.174447:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00080000:2.0:1783969354.175063:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969354.181755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969354.181873:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074023168 00000100:00100000:3.0:1783969354.181886:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074023168 00000100:00100000:3.0:1783969354.181991:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:3.0:1783969354.182005:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:11087:x1870627074023168:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783969354.182152:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+5:11087:x1870627074023168:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 150us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969354.182161:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00080000:2.0:1783969354.182670:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969354.190373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969354.190702:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074023424 00000100:00100000:0.0:1783969354.190717:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074023424 00000100:00100000:0.0:1783969354.190816:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:0.0:1783969354.190828:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+13:11087:x1870627074023424:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783969354.191151:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+14:11087:x1870627074023424:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 324us (792us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783969354.191160:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:1.0:1783969354.489084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969354.490949:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074023552 00000100:00100000:2.0:1783969354.490971:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074023552 00000100:00100000:2.0:1783969354.491133:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:2.0:1783969354.491148:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:11893:x1870627074023552:12345-192.168.201.34@tcp:101:lsof.0 00010000:00010000:2.0:1783969354.491178:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969354.491211:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba4c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039dd expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969354.491328:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969354.491347:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969354.491365:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969354.491509:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783969354.491514:0:7749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969354.491568:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969354.491599:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba4c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039dd expref: 7 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969354.491623:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039dd expref: 6 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969354.491634:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:2.0:1783969354.491651:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969354.491656:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae600, rc 0) 00000100:00100000:2.0:1783969354.491749:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:11893:x1870627074023552:12345-192.168.201.34@tcp:101:lsof.0 Request processed in 605us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969354.491758:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00080000:0.0:1783969354.492996:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783969354.547038:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969354.608685:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969354.610804:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099263488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969354.610948:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969354.620021:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099263488 00000100:00100000:1.0:1783969354.620045:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099263488 00000100:00100000:1.0:1783969354.620815:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783969354.620830:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099263488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969354.620893:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783969354.621092:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099263488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 265us (10143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969354.621110:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783969354.622968:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099263488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969355.121414:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099263616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969355.121517:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969355.121708:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099263616 00000100:00100000:1.0:1783969355.121718:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099263616 00000100:00100000:1.0:1783969355.121784:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783969355.121795:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099263616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969355.121850:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969355.121910:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099263616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969355.121936:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783969355.121991:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab9176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099263616:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783969355.572598:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969355.632931:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969355.632974:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099263744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969355.633049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969355.633409:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099263744 00000100:00100000:0.0:1783969355.633418:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099263744 00000100:00100000:0.0:1783969355.633494:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783969355.633505:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099263744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969355.633538:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783969355.633589:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099263744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969355.633595:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783969355.633640:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099263744:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783969355.633864:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969355.634621:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099263872:0@lo:400:kworker.0 00000100:00100000:1.0:1783969355.634665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969355.634703:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099264128:0@lo:400:kworker.0 00000100:00100000:1.0:1783969355.634727:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969355.634743:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969355.634747:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099264000:0@lo:400:kworker.0 00000100:00100000:1.0:1783969355.634769:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969355.634795:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099264000 00000100:00100000:1.0:1783969355.634799:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099264000 00000100:00100000:1.0:1783969355.634845:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1783969355.634852:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099264000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969355.634893:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099264000:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969355.634900:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1783969355.634947:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099264000:0@lo:400:kworker.0 00000100:00100000:1.0:1783969355.634968:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099264128 00000100:00100000:1.0:1783969355.634971:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099264128 00000100:00100000:1.0:1783969355.634993:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783969355.634999:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099264128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969355.635033:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099264128:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969355.635039:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783969355.635081:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099264128:0@lo:400:kworker.0 00000100:00100000:2.0:1783969355.635451:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099264512:0@lo:400:kworker.0 00000100:00100000:2.0:1783969355.635495:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969355.635523:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099265024:0@lo:400:kworker.0 00000100:00100000:2.0:1783969355.635545:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969355.635562:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783969355.635567:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099264640:0@lo:400:kworker.0 00000100:00100000:2.0:1783969355.635590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969355.635609:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099265152:0@lo:400:kworker.0 00000100:00100000:2.0:1783969355.635629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969355.635653:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099264640 00000100:00100000:2.0:1783969355.635656:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099264640 00000100:00100000:2.0:1783969355.635691:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099265152 00000100:00100000:2.0:1783969355.635694:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099265152 00000100:00100000:2.0:1783969355.635716:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783969355.635721:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099264640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969355.635758:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099264640:12345-0@lo:400:kworker.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969355.635764:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783969355.635778:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783969355.635783:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98362b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099265152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969355.635809:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98362b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099265152:12345-0@lo:400:kworker.0 Request processed in 27us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969355.635814:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783969355.635856:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099264640:0@lo:400:kworker.0 00000100:00100000:2.0:1783969355.635865:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099265152:0@lo:400:kworker.0 00000100:00080000:2.0:1783969355.635882:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969355.635886:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969355.636241:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099264256:0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.636279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969355.636302:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099264768:0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.636322:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969355.636340:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783969355.636346:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099264384:0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.636366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969355.636430:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099264896:0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.636454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969355.636492:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099264768 00000100:00100000:3.0:1783969355.636496:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099264768 00000100:00100000:3.0:1783969355.636528:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783969355.636534:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099264768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.636570:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099264768:12345-0@lo:400:kworker.0 Request processed in 36us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969355.636576:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783969355.636603:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099264512 00000100:00100000:3.0:1783969355.636607:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099264512 00000100:00100000:3.0:1783969355.636629:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099265024 00000100:00100000:3.0:1783969355.636631:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099265024 00000100:00100000:3.0:1783969355.636643:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099264256 00000100:00100000:3.0:1783969355.636645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099264256 00000100:00100000:3.0:1783969355.636653:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099264384 00000100:00100000:3.0:1783969355.636655:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099264384 00000100:00100000:3.0:1783969355.636665:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099264896 00000100:00100000:3.0:1783969355.636668:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099264896 00000100:00100000:3.0:1783969355.636679:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1783969355.636684:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099264512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.636716:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099264512:12345-0@lo:400:kworker.0 Request processed in 32us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969355.636722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1783969355.636733:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1783969355.636738:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099265024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.636763:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099265024:12345-0@lo:400:kworker.0 Request processed in 26us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969355.636778:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1783969355.636790:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1783969355.636795:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099264256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.636835:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099264256:12345-0@lo:400:kworker.0 Request processed in 28us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969355.636841:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1783969355.636853:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1783969355.636858:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099264384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.636886:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099264384:12345-0@lo:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969355.636892:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1783969355.636901:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1783969355.636907:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099264896:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783969355.637540:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf92b800 x1870627099264512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969355.637564:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099264512:0@lo:400:kworker.0 00010000:00080000:2.0:1783969355.637581:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983741880 x1870627099265024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969355.637590:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099265024:0@lo:400:kworker.0 00000100:00080000:1.0:1783969355.638225:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969355.638231:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969355.638234:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969355.638288:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099264384:0@lo:400:kworker.0 00000100:00100000:1.0:1783969355.638304:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099264256:0@lo:400:kworker.0 00000100:00100000:1.0:1783969355.638315:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099264768:0@lo:400:kworker.0 00000100:00100000:3.0:1783969355.638678:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099264896:12345-0@lo:400:kworker.0 Request processed in 1769us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969355.638688:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1783969355.639021:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099263872 00000100:00100000:0.0:1783969355.639032:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099263872 00000100:00100000:0.0:1783969355.639096:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1783969355.639108:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099263872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969355.639191:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099263872:12345-0@lo:400:kworker.0 Request processed in 87us (4526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969355.639199:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1783969355.643006:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099265280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969355.643100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969355.643171:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099264896:0@lo:400:kworker.0 00000100:00100000:0.0:1783969355.644298:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099265280 00000100:00100000:0.0:1783969355.644316:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099265280 00000100:00100000:0.0:1783969355.644465:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783969355.644501:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099265280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969355.644554:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783969355.644669:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099265280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 172us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969355.644678:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783969355.645646:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099263872:0@lo:400:kworker.0 00000100:00100000:1.0:1783969355.646479:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099265280:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1783969355.647906:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:1.0:1783969355.647932:0:6500:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1783969355.648782:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1783969355.648809:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1783969356.144726:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099265408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969356.144808:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969356.144891:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099265408 00000100:00100000:0.0:1783969356.144907:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099265408 00000100:00100000:0.0:1783969356.145068:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783969356.145086:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab9174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099265408:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969356.145115:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099265536:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969356.145133:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969356.145160:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969356.145227:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab9174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099265408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969356.145236:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783969356.151038:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099265408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969356.155255:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099265536 00000100:00100000:0.0:1783969356.155278:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099265536 00000100:00100000:3.0:1783969356.155565:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783969356.155590:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099265536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969356.155622:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969356.155790:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099265536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 211us (10631us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969356.155824:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783969356.160415:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099265536:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1783969356.208668:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969356.208681:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969356.208835:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1783969356.208845:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783969356.593170:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783969357.553457:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783969357.579876:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969357.580596:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074023680 00000100:00100000:0.0:1783969357.580608:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074023680 00000100:00100000:0.0:1783969357.580675:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 399 00000100:00100000:0.0:1783969357.580686:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074023680:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969357.580769:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074023680:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 85us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969357.580777:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 399 00000100:00100000:1.0:1783969357.589232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969357.589289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969357.589323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969357.589357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969357.589420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969357.589452:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969357.589483:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074023808 00000100:00100000:1.0:1783969357.589493:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074023808 00000100:00100000:1.0:1783969357.589552:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074024320 00000100:00100000:1.0:1783969357.589571:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074024320 00000100:00100000:1.0:1783969357.589593:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074023936 00000100:00100000:1.0:1783969357.589596:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074023936 00000100:00100000:1.0:1783969357.589610:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074024448 00000100:00100000:1.0:1783969357.589612:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074024448 00000100:00100000:1.0:1783969357.589626:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 346 00000100:00100000:1.0:1783969357.589636:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+13:2392:x1870627074023808:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969357.589712:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+13:2392:x1870627074023808:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 76us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969357.589721:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 346 00000100:00100000:1.0:1783969357.589738:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 347 00000100:00100000:1.0:1783969357.589743:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2392:x1870627074024320:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969357.589767:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2392:x1870627074024320:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969357.589774:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 347 00000100:00100000:1.0:1783969357.589787:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 348 00000100:00100000:1.0:1783969357.589803:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074023936:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969357.589830:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074023936:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969357.589836:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 348 00000100:00100000:1.0:1783969357.589848:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 349 00000100:00100000:1.0:1783969357.589855:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074024448:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969357.589879:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074024448:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969357.589885:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 349 00000100:00100000:1.0:1783969357.589916:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074024064 00000100:00100000:1.0:1783969357.589921:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074024064 00000100:00100000:1.0:1783969357.589945:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074024192 00000100:00100000:1.0:1783969357.589948:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074024192 00000100:00100000:1.0:1783969357.589966:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1783969357.589972:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074024064:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969357.590000:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074024064:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969357.590005:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1783969357.590016:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:1.0:1783969357.590021:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074024192:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969357.590041:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074024192:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 20us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969357.590046:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00080000:1.0:1783969357.590064:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969357.590068:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969357.590071:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969357.590073:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783969357.618939:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969358.640625:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783969359.307328:0:14530:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:02:36 (1783969356) 00010000:00010000:1.0:1783969359.664823:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969359.731284:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099265664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969359.731423:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969359.731696:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099265664 00000100:00100000:1.0:1783969359.731707:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099265664 00000100:00100000:1.0:1783969359.731909:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783969359.731921:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099265664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969359.731976:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783969359.732050:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099265664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969359.732077:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783969359.732879:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099265664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969360.242233:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099265792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969360.242362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969360.243025:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099265792 00000100:00100000:2.0:1783969360.243039:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099265792 00000100:00100000:2.0:1783969360.243121:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1783969360.243137:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099265792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969360.243188:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969360.243276:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099265792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969360.243284:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783969360.243453:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099265792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783969360.692207:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969360.754790:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099266048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969360.754791:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099265920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969360.754950:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099266304:0@lo:400:kworker.0 00000100:00100000:2.0:1783969360.754995:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099266176:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.764469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969360.765317:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099265920 00000100:00100000:1.0:1783969360.765334:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099265920 00000100:00100000:1.0:1783969360.765459:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783969360.765474:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099265920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969360.765520:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783969360.767195:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099265920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1713us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969360.767213:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1783969360.767272:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969360.767345:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099265920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969360.767487:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099266432:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.767557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969360.767654:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969360.767661:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099266816:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.767707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969360.767757:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099266816 00000100:00100000:1.0:1783969360.767764:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099266816 00000100:00100000:1.0:1783969360.767824:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783969360.767835:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099266816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.767888:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099266816:12345-0@lo:400:kworker.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969360.767912:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:1.0:1783969360.767935:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783969360.767958:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98360a680 x1870627099266816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969360.767971:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099266816:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768007:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099266944:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969360.768083:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099266944 00000100:00100000:1.0:1783969360.768087:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099266944 00000100:00100000:1.0:1783969360.768123:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783969360.768131:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099266944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768170:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099266944:12345-0@lo:400:kworker.0 Request processed in 40us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969360.768177:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1783969360.768196:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969360.768215:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099266944:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768277:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099267456:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969360.768331:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969360.768336:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099267328:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768360:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969360.768412:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099267328 00000100:00100000:1.0:1783969360.768417:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099267328 00000100:00100000:1.0:1783969360.768451:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1783969360.768458:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099267328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768507:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099267328:12345-0@lo:400:kworker.0 Request processed in 49us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969360.768513:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:1.0:1783969360.768532:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783969360.768550:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e9837d1f80 x1870627099267328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969360.768561:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099267328:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768605:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099267456 00000100:00100000:1.0:1783969360.768609:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099267456 00000100:00100000:1.0:1783969360.768640:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783969360.768645:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099267456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768681:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099267456:12345-0@lo:400:kworker.0 Request processed in 36us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969360.768687:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1783969360.768704:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969360.768716:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099266432 00000100:00100000:1.0:1783969360.768720:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099266432 00000100:00100000:1.0:1783969360.768768:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783969360.768775:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099266432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768812:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099266432:12345-0@lo:400:kworker.0 Request processed in 37us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969360.768818:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783969360.768843:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099267456:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.768854:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099266432:0@lo:400:kworker.0 00000100:00100000:3.0:1783969360.777007:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969360.777067:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099266048 00000100:00100000:1.0:1783969360.777098:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099266048 00000100:00100000:3.0:1783969360.777102:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099266560:0@lo:400:kworker.0 00000100:00100000:3.0:1783969360.777150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969360.777158:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783969360.777169:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099266048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969360.777173:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099267072:0@lo:400:kworker.0 00000100:00100000:3.0:1783969360.777198:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1783969360.777208:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783969360.777220:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099267072 00000100:00100000:3.0:1783969360.777223:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099267072 00000100:00100000:1.0:1783969360.777261:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099266048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969360.777264:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783969360.777268:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783969360.777270:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099267072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969360.777303:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099267072:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969360.777310:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783969360.777354:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099267072:0@lo:400:kworker.0 00000100:00100000:3.0:1783969360.777374:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099266048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969360.777428:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783969360.777437:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099266688:0@lo:400:kworker.0 00000100:00100000:3.0:1783969360.777464:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969360.777482:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099267200:0@lo:400:kworker.0 00000100:00100000:3.0:1783969360.777504:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969360.783053:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969360.783126:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099266176 00000100:00100000:2.0:1783969360.783138:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099266176 00000100:00100000:2.0:1783969360.783203:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1783969360.783214:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099266176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969360.783276:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099266176:12345-0@lo:400:kworker.0 Request processed in 63us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969360.783302:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1783969360.783403:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099266176:0@lo:400:kworker.0 00000100:00100000:0.0:1783969360.791850:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099266560 00000100:00100000:0.0:1783969360.791872:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099266560 00000100:00100000:0.0:1783969360.791958:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099266688 00000100:00100000:0.0:1783969360.791961:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099266688 00000100:00100000:3.0:1783969360.791977:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099267200 00000100:00100000:3.0:1783969360.791982:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099267200 00000100:00100000:0.0:1783969360.791999:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783969360.792010:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099266560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969360.792022:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1783969360.792028:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099266688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969360.793348:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1783969360.793377:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099267200:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783969360.793558:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969360.793566:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969360.801156:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870627099266688:12345-0@lo:400:kworker.0 Request processed in 9109us (23672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969360.801179:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1783969360.803249:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099266688:0@lo:400:kworker.0 00000100:00100000:0.0:1783969360.809126:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099266560:12345-0@lo:400:kworker.0 Request processed in 17101us (31957us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969360.809147:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1783969360.810700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969360.810918:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099266304 00000100:00100000:0.0:1783969360.810930:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099266304 00000100:00100000:0.0:1783969360.811004:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1783969360.811017:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099266304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969360.811095:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099266560:0@lo:400:kworker.0 00000100:00100000:0.0:1783969360.811132:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099266304:12345-0@lo:400:kworker.0 Request processed in 118us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969360.811139:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1783969360.811188:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099266304:0@lo:400:kworker.0 00000100:00100000:2.0:1783969360.811496:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099267200:12345-0@lo:400:kworker.0 Request processed in 18131us (33986us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969360.811505:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783969360.811524:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099267200:0@lo:400:kworker.0 00000100:00100000:1.0:1783969360.969728:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969360.969952:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074024704 00000100:00100000:3.0:1783969360.969965:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074024704 00000100:00100000:3.0:1783969360.970085:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:3.0:1783969360.970099:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+13:12160:x1870627074024704:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969360.970127:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969360.970154:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039e4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970252:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970298:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970315:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970334:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970341:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970348:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970532:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba4e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970541:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970549:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969360.970561:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1783969360.970687:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970696:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970703:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970715:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969360.970721:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970730:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970752:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ea911e6500) 00010000:00010000:3.0:1783969360.970755:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969360.970761:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970768:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba4d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970784:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970790:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970796:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970801:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969360.970804:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.970810:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783969360.972179:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969360.972346:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93ea911e6100) 00010000:00010000:3.0:1783969360.972353:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969360.972360:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.972371:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba4dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.973425:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba4cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039e4 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.973457:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039e4 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969360.973465:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:3.0:1783969360.973468:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969360.973471:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52000, rc 0) 00000100:00100000:3.0:1783969360.973577:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+15:12160:x1870627074024704:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3480us (3861us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1783969360.973587:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:2.0:1783969360.985343:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969360.987589:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074024832 00000100:00100000:0.0:1783969360.987610:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074024832 00000100:00100000:0.0:1783969360.987703:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:0.0:1783969360.987715:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+15:12160:x1870627074024832:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783969360.987900:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+15:12160:x1870627074024832:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 186us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969360.987909:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:2.0:1783969360.996376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969360.998183:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074024960 00000100:00100000:1.0:1783969360.998204:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074024960 00000100:00100000:1.0:1783969360.998965:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1783969360.998984:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+15:2392:x1870627074024960:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969360.999018:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969360.999063:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba4e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039e4 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969360.999093:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:1.0:1783969360.999101:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969360.999201:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+14:2392:x1870627074024960:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 223us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969360.999210:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1783969361.004439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969361.004564:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074025088 00000100:00100000:0.0:1783969361.004577:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074025088 00000100:00100000:0.0:1783969361.004668:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00100000:0.0:1783969361.004681:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:12160:x1870627074025088:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783969361.004870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:12160:x1870627074025088:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 192us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969361.004879:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00080000:3.0:1783969361.006914:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969361.267622:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969361.267656:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099267584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969361.267779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969361.267869:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099267584 00000100:00100000:2.0:1783969361.267880:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099267584 00000100:00100000:2.0:1783969361.267950:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783969361.267962:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099267584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969361.268006:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969361.268061:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099267584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969361.268070:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783969361.268136:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099267584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969361.268972:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969361.268990:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099267712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969361.269044:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969361.270243:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099267712 00000100:00100000:3.0:1783969361.270261:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099267712 00000100:00100000:3.0:1783969361.270495:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783969361.270508:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099267712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969361.270543:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969361.270661:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099267712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 155us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969361.270669:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783969361.271429:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099267712:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1783969361.328786:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969361.328799:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969361.329351:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1783969361.329424:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783969361.650040:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783969361.718689:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783969361.785668:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:3.0:1783969362.702534:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969362.702589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969362.702622:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969362.702673:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074025472 00000100:00100000:3.0:1783969362.702686:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074025472 00000100:00100000:3.0:1783969362.702766:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074025344 00000100:00100000:3.0:1783969362.702770:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074025344 00000100:00100000:0.0:1783969362.702989:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074025216 00000100:00100000:0.0:1783969362.702994:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074025216 00000100:00100000:0.0:1783969362.703034:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 401 00000100:00100000:0.0:1783969362.703047:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074025216:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969362.703144:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eaa5ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074025216:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 98us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969362.703153:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 401 00000100:00100000:3.0:1783969362.703227:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 356 00000100:00100000:3.0:1783969362.703236:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074025472:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969362.703273:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074025472:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 39us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969362.703280:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 356 00000100:00100000:3.0:1783969362.703294:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 357 00000100:00100000:3.0:1783969362.703301:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+13:2391:x1870627074025344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969362.703341:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+13:2391:x1870627074025344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969362.703347:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 357 00000100:00080000:3.0:1783969362.703371:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969362.713557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969362.713655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969362.718370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969362.718495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969362.718527:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074025984 00000100:00100000:0.0:1783969362.718539:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074025984 00000100:00100000:0.0:1783969362.718619:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074025856 00000100:00100000:0.0:1783969362.721500:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074025856 00000100:00100000:0.0:1783969362.721610:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 358 00000100:00100000:0.0:1783969362.721623:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074025984:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969362.721764:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074025984:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 144us (3409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969362.721773:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 358 00000100:00100000:0.0:1783969362.721794:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 359 00000100:00100000:0.0:1783969362.721813:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2392:x1870627074025856:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969362.721842:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2392:x1870627074025856:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 42us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969362.721849:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 359 00000100:00080000:0.0:1783969362.721885:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969362.721890:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969362.724490:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074025600 00000100:00100000:1.0:1783969362.724512:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074025600 00000100:00080000:1.0:1783969362.724559:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969362.724625:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074025728 00000100:00100000:1.0:1783969362.724991:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074025728 00000100:00100000:1.0:1783969362.725055:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:1.0:1783969362.725068:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074025728:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969362.725186:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074025728:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 119us (11528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969362.725194:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:1.0:1783969362.725218:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:1.0:1783969362.725225:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2390:x1870627074025600:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:1.0:1783969362.725248:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9e8c 00000100:00080000:1.0:1783969362.725260:0:8436:0:(import.c:65:import_set_state_nolock()) ffff93eabf7ba800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783969362.725324:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967305 00000100:00080000:0.0:1783969362.726531:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969362.728292:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+2:2390:x1870627074025600:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 3054us (14735us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969362.728309:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00010000:00010000:1.0:1783969362.728364:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969362.739512:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969363.380434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969363.380500:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074026112 00000100:00100000:1.0:1783969363.380515:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074026112 00000100:00100000:1.0:1783969363.380602:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:1.0:1783969363.380625:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+13:12202:x1870627074026112:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969363.380655:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969363.380694:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba4f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039eb expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.380804:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.380824:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.380840:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.380858:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.380865:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.380873:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381190:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381199:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381206:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381212:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2177600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969363.381217:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381239:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381256:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:1.0:1783969363.381260:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969363.381266:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381274:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba4f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381293:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381299:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381304:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381309:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969363.381312:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381318:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381326:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93e982253200) 00010000:00010000:1.0:1783969363.381328:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969363.381330:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381347:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba500 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381831:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba4f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039eb expref: 14 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381848:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:1.0:1783969363.381851:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969363.381855:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba4f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039eb expref: 14 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.381866:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2176600, rc 0) 00000100:00100000:1.0:1783969363.382210:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+13:12202:x1870627074026112:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1595us (1791us total) trans 0 rc 301/301 00000100:00100000:1.0:1783969363.382220:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:1.0:1783969363.408258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969363.414188:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074026368 00000100:00100000:3.0:1783969363.414213:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074026368 00000100:00100000:3.0:1783969363.414319:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:3.0:1783969363.414332:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+13:12202:x1870627074026368:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:3.0:1783969363.415184:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969363.415236:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cb9e46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630380f expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.415261:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:3.0:1783969363.415267:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969363.415355:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.415372:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039dd expref: 5 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.416168:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.416238:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039dd expref: 5 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.416262:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039dd expref: 5 pid: 7749 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969363.416282:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099267840:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969363.416573:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9138a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969363.419189:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099267840:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969363.419231:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969363.419766:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969363.419932:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074026496 00000100:00100000:3.0:1783969363.419954:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074026496 00010000:00010000:3.0:1783969363.420006:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039dd expref: 6 pid: 7749 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969363.420083:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:3.0:1783969363.420115:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2391:x1870627074026496:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969363.420138:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969363.420145:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039dd expref: 6 pid: 7749 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.420158:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039dd expref: 6 pid: 7749 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.420188:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba4c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039dd expref: 6 pid: 7749 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.420208:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:3.0:1783969363.420213:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.420224:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.420232:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.420259:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969363.420343:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074026496:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 230us (580us total) trans 0 rc 0/0 00010000:00010000:2.0:1783969363.420414:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.420424:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.420464:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.420474:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.420483:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423240:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423269:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423281:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969363.423302:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000430969a2 reply state 000000001d31108c transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423314:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423322:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969363.423326:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969363.423331:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783969363.423338:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783969363.423348:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423356:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423374:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423399:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969363.423405:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423413:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423425:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982170300) 00010000:00010000:2.0:1783969363.423428:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969363.423433:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423440:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba507 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969363.423462:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000430969a2 reply state 000000001d31108c transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423471:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.423478:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93e982170700) 00010000:00010000:2.0:1783969363.423481:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969363.423484:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783969363.423600:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+14:12202:x1870627074026368:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 9265us (15353us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1783969363.423612:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:3.0:1783969363.428850:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:3.0:1783969363.552086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969363.552215:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074026624 00000100:00100000:1.0:1783969363.552228:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074026624 00000100:00100000:1.0:1783969363.552307:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 155 00000100:00100000:1.0:1783969363.552316:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+14:12210:x1870627074026624:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:1.0:1783969363.552354:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969363.552424:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba51c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039f2 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.552506:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba523 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.552519:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.552531:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969363.552586:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783969363.552589:0:9027:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969363.552625:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.552649:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba51c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039f2 expref: 16 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.552666:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039f2 expref: 15 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.552676:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253200) 00010000:00010000:1.0:1783969363.552680:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969363.552683:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2177600, rc 0) 00000100:00100000:1.0:1783969363.552771:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+15:12210:x1870627074026624:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 455us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969363.552779:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 155 00000100:00100000:3.0:1783969363.621495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969363.621633:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074026752 00000100:00100000:1.0:1783969363.621658:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074026752 00000100:00100000:1.0:1783969363.621737:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 156 00000100:00100000:1.0:1783969363.621757:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+15:12216:x1870627074026752:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1783969363.621778:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969363.621799:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba52a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d3563039f9 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.621877:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.621892:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.621917:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.621929:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.621937:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.621943:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622028:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600800/0xea31253a47cba53f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622037:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600800/0xea31253a47cba53f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622043:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600800/0xea31253a47cba53f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969363.622090:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783969363.622094:0:13769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969363.622123:0:13769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600800/0xea31253a47cba53f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622136:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622142:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622148:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622153:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969363.622157:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622165:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622178:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253200) 00010000:00010000:1.0:1783969363.622180:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969363.622185:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622190:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622204:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622220:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622226:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622230:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969363.622233:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622239:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622247:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93e982170700) 00010000:00010000:1.0:1783969363.622250:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969363.622252:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622259:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba538 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622285:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba52a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039f9 expref: 17 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622298:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600800/0xea31253a47cba53f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039f9 expref: 16 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.622305:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969363.622308:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783969363.622316:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600800, rc 0) 00000100:00100000:1.0:1783969363.622424:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+16:12216:x1870627074026752:12345-192.168.201.34@tcp:101:bash.0 Request processed in 623us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969363.622434:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 156 00000100:00100000:2.0:1783969363.634944:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969363.635131:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074027008 00000100:00100000:1.0:1783969363.635145:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074027008 00000100:00100000:1.0:1783969363.635228:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 157 00000100:00100000:1.0:1783969363.635239:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+16:12216:x1870627074027008:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1783969363.635278:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969363.635305:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba546 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a00 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.635474:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.635488:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.635499:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.637897:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.637921:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.637934:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783969363.640661:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1783969363.640911:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.640931:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.640943:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.640986:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.640993:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.641000:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.641005:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969363.641009:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.641016:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.644947:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969363.644959:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969363.644968:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.644979:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba54d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969363.645669:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000177dc8b0 reply state 0000000049dbc93f transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.645690:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.648890:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253800) 00010000:00010000:1.0:1783969363.648897:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783969363.648904:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783969363.648976:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba546 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a00 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.649007:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a00 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.649016:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982253400) 00010000:00010000:1.0:1783969363.649019:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969363.650270:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2176400, rc 0) 00000100:00100000:1.0:1783969363.650361:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:12216:x1870627074027008:12345-192.168.201.34@tcp:101:bash.0 Request processed in 15120us (15430us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1783969363.650371:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 157 00000100:00100000:0.0:1783969363.668783:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969363.669060:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074027136 00000100:00100000:3.0:1783969363.669070:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074027136 00000100:00100000:3.0:1783969363.669142:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1783969363.669150:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1870627074027136:12345-192.168.201.34@tcp:8:bash.0 00010000:00080000:3.0:1783969363.669186:0:8439:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:3.0:1783969363.669216:0:8439:0:(genops.c:1406:class_connect()) connect: client c481ab09-d97e-4adb-b42e-68f98b038d20, cookie 0xea31253a47cba569 00002000:00100000:3.0:1783969363.669228:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c481ab09-d97e-4adb-b42e-68f98b038d20/ffff93e983e52800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 25255936 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783969363.669246:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783969363.669342:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783969363.669372:0:8439:0:(import.c:65:import_set_state_nolock()) ffff93e983e50000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969363.669489:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2390:x1870627074027136:12345-192.168.201.34@tcp:8:bash.0 Request processed in 337us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969363.669497:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1783969363.674240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969363.674574:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074027264 00000100:00100000:0.0:1783969363.674583:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074027264 00000100:00100000:0.0:1783969363.674828:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:0.0:1783969363.674839:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+6:0:x1870627074027264:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969363.674867:0:9974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969363.674891:0:9974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a07 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969363.677850:0:9974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969363.677894:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1783969363.677900:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969363.677935:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a07 expref: 7 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969363.677963:0:9974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a07 expref: 7 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969363.677978:0:9974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796000, rc 0) 00000100:00100000:0.0:1783969363.678062:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:0:x1870627074027264:12345-192.168.201.34@tcp:101:bash.0 Request processed in 3223us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969363.678072:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00080000:1.0:1783969363.686622:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969363.689639:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969363.690448:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074027392 00000100:00100000:3.0:1783969363.690460:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074027392 00000100:00100000:3.0:1783969363.690529:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1783969363.690539:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+7:12216:x1870627074027392:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1783969363.690561:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969363.690580:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a0e expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.690615:0:14243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a07 expref: 8 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.690624:0:14243:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969363.690629:0:14243:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969363.690635:0:14243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 8 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.690686:0:14243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a07 expref: 8 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.690709:0:14243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a07 expref: 8 pid: 9974 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969363.690724:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9836df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14243:1870627099267968:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969363.690846:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9138a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969363.695188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969363.695358:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074027520 00000100:00100000:2.0:1783969363.695368:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074027520 00010000:00010000:2.0:1783969363.695452:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a07 expref: 9 pid: 9974 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969363.695495:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:2.0:1783969363.695505:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2392:x1870627074027520:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969363.695522:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969363.695543:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a07 expref: 9 pid: 9974 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.695556:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a07 expref: 9 pid: 9974 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.695581:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969363.695585:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969363.695593:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 9 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.695604:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 9 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.695640:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 9 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969363.695676:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983743100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1870627099268096:192.168.201.34@tcp:105: 00000100:00100000:2.0:1783969363.695775:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea857bf600 going to sleep for 11 seconds 00010000:00010000:1.0:1783969363.696194:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba570 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a07 expref: 9 pid: 9974 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969363.696212:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9836df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14243:1870627099267968:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969363.696235:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 8 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.696255:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52400, rc 0) 00000100:00100000:1.0:1783969363.696304:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+8:12216:x1870627074027392:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5766us (6673us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969363.696321:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:1.0:1783969363.699950:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983743100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1870627099268096:192.168.201.34@tcp:105: 00010000:00010000:1.0:1783969363.699982:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969363.700056:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2392:x1870627074027520:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4552us (4877us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969363.700068:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:2.0:1783969363.712502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969363.712576:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074027776 00000100:00100000:1.0:1783969363.712587:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074027776 00000100:00100000:1.0:1783969363.712643:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1783969363.712654:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:12216:x1870627074027776:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1783969363.713014:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+20:12216:x1870627074027776:12345-192.168.201.34@tcp:35:bash.0 Request processed in 359us (520us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1783969363.713023:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:3.0:1783969363.724254:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969363.724304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969363.724812:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074028032 00000100:00100000:0.0:1783969363.724823:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074028032 00000100:00100000:0.0:1783969363.724898:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:0.0:1783969363.724910:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074028032:12345-192.168.201.34@tcp:16:kworker.0 00000100:00100000:0.0:1783969363.725051:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074028032:12345-192.168.201.34@tcp:16:kworker.0 Request processed in 143us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969363.725059:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:1.0:1783969363.725143:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074027904 00000100:00100000:1.0:1783969363.725148:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074027904 00002000:00100000:1.0:1783969363.725179:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff93ea85f97480 x1870627074027904/t0(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:259/0 lens 504/0 e 0 to 0 dl 1783969374 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783969363.725191:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93ea85f97480 with x1870627074027904 ext(0->12) 00002000:00010000:1.0:1783969363.725197:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93ea85f97480 00000100:00100000:1.0:1783969363.725224:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1783969363.725232:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074027904:12345-192.168.201.34@tcp:4:bash.0 00000001:00100000:0.0:1783969363.736306:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000001:00100000:0.0:1783969363.736318:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:0.0:1783969363.736322:0:8432:0:(genops.c:906:class_export_put()) final put ffff93eabf7bf800/c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:2.0:1783969363.736433:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eabf7bf800/c481ab09-d97e-4adb-b42e-68f98b038d20 for lustre-OST0000 00000020:00000080:2.0:1783969363.736486:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eabf7ba800 for lustre-OST0000 00000100:00100000:1.0:1783969363.737123:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2393:x1870627074027904:12345-192.168.201.34@tcp:4:bash.0 Request processed in 11882us (12809us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783969363.737138:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00002000:00100000:1.0:1783969363.737153:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff93ea85f97480 x1870627074027904/t4294967306(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:259/0 lens 504/448 e 0 to 0 dl 1783969374 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783969363.737164:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93ea85f97480 with x1870627074027904 ext(0->12) 00002000:00010000:1.0:1783969363.737171:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93ea85f97480 00010000:00010000:2.0:1783969363.760967:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969363.844915:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969363.844996:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074028288 00000100:00100000:1.0:1783969363.845007:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074028288 00000100:00100000:1.0:1783969363.845072:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:1.0:1783969363.845082:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+20:12226:x1870627074028288:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969363.845223:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969363.845249:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba57e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a15 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969363.845357:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783969363.845497:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba57e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a15 expref: 22 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.845512:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253200) 00010000:00010000:1.0:1783969363.845515:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783969363.845520:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba57e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a15 expref: 22 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.845535:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2176600, rc 0) 00000100:00100000:1.0:1783969363.845610:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+21:12226:x1870627074028288:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 529us (716us total) trans 4294967422 rc 301/301 00000100:00100000:1.0:1783969363.845634:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:2.0:1783969363.848799:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969363.848962:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074028544 00000100:00100000:0.0:1783969363.848972:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074028544 00000100:00100000:0.0:1783969363.849026:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:0.0:1783969363.849037:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+21:12226:x1870627074028544:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969363.849258:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+22:12226:x1870627074028544:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 223us (470us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1783969363.849278:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:2.0:1783969363.957595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969363.957700:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074028672 00000100:00100000:1.0:1783969363.957710:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074028672 00000100:00100000:1.0:1783969363.957782:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:1.0:1783969363.957794:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+22:12232:x1870627074028672:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969363.957819:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969363.957841:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba58c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a1c expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.957911:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba593 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.957925:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.957939:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969363.957991:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783969363.957996:0:13769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969363.958018:0:13769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.958046:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba58c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a1c expref: 24 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.958069:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a1c expref: 23 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969363.958103:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969363.958107:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969363.958110:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600200, rc 0) 00000100:00100000:1.0:1783969363.958178:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+23:12232:x1870627074028672:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 387us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969363.958185:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:3.0:1783969363.963904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969363.964313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074028928 00000100:00100000:2.0:1783969363.964323:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074028928 00000100:00100000:2.0:1783969363.964415:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 160 00000100:00100000:2.0:1783969363.964426:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+23:12232:x1870627074028928:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969363.964447:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969363.964469:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba59a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.964603:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba5a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.964619:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.964630:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969363.964643:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783969363.964777:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba59a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a23 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.964812:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a23 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969363.964821:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982253400) 00010000:00010000:2.0:1783969363.964824:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969363.964827:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dafc00, rc 0) 00000100:00100000:2.0:1783969363.964901:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+25:12232:x1870627074028928:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 477us (1007us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1783969363.964908:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 160 00000100:00100000:2.0:1783969363.975274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969363.975432:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969363.975608:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074029312 00000100:00100000:3.0:1783969363.975617:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074029312 00000100:00100000:3.0:1783969363.975680:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 161 00000100:00100000:3.0:1783969363.975703:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+25:12232:x1870627074029312:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969363.975730:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969363.975752:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba5af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a2a expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.975884:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba5b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.975914:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.975941:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969363.975957:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783969363.976072:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba5af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a2a expref: 28 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.976093:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba5b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a2a expref: 27 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969363.976101:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982253400) 00010000:00010000:3.0:1783969363.976104:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969363.976108:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53e00, rc 0) 00000100:00100000:3.0:1783969363.976174:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12232:x1870627074029312:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 485us (741us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1783969363.976181:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 161 00000100:00100000:0.0:1783969363.981627:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074029056 00000100:00100000:0.0:1783969363.981643:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074029056 00000100:00100000:0.0:1783969363.981723:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1783969363.981735:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+27:2394:x1870627074029056:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969363.981751:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969363.981786:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba5a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a23 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969363.981807:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982253400) 00010000:00010000:0.0:1783969363.981812:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969363.981881:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+26:2394:x1870627074029056:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 148us (6620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969363.981889:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1783969363.991145:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969363.991237:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074029440 00000100:00100000:0.0:1783969363.991247:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074029440 00000100:00100000:0.0:1783969363.991304:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:0.0:1783969363.991314:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2393:x1870627074029440:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:0.0:1783969363.991363:0:9974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969363.991419:0:9974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 8 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969363.991429:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783969363.991447:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969363.991453:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969363.991493:0:9974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 8 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969363.991508:0:9974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 8 pid: 14243 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969363.991535:0:9974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9974:1870627099268224:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969363.991932:0:9974:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969363.995924:0:9974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9974:1870627099268224:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969363.995955:0:9974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969364.000122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969364.001171:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074029568 00000100:00100000:3.0:1783969364.001185:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074029568 00010000:00010000:3.0:1783969364.001233:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 9 pid: 14243 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969364.001287:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:3.0:1783969364.001298:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2391:x1870627074029568:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969364.001315:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783969364.001335:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783969364.001339:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783969362 00002000:00010000:3.0:1783969364.001354:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1783969362 00002000:00010000:3.0:1783969364.001357:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783969364.001364:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 9 pid: 14243 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.001505:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 9 pid: 14243 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.001653:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055bc6494/0xea31253a47cba577 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a0e expref: 9 pid: 14243 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.002642:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969364.002651:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969364.002659:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.002740:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.002942:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969364.003022:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074029568:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 1722us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969364.003033:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00010000:00010000:0.0:1783969364.004491:0:9974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.004562:0:9974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.004651:0:9974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.004662:0:9974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.004880:0:9974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.004887:0:9974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969364.004892:0:9974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.004902:0:9974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.004920:0:9974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.004928:0:9974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016cc5d3c/0xea31253a47cba5c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969364.005080:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074029440:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 13763us (13940us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969364.005091:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:2.0:1783969364.009148:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969364.009233:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074029824 00000100:00100000:0.0:1783969364.009243:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074029824 00000100:00100000:0.0:1783969364.009324:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1783969364.009335:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+26:12232:x1870627074029824:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:0.0:1783969364.009436:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba5b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a2a expref: 26 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969364.009702:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1783969364.009737:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1783969364.010234:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:0.0:1783969364.010274:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.010290:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a00 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.010298:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.010332:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a00 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.010346:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a00 expref: 30 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969364.010362:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1870627099268352:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969364.010489:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064e40 going to sleep for 11 seconds 00000100:00080000:2.0:1783969364.011216:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969364.016743:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1870627099268352:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969364.016907:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969364.018331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969364.018596:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074029952 00000100:00100000:3.0:1783969364.018605:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074029952 00010000:00010000:3.0:1783969364.018645:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a00 expref: 31 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969364.018723:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:3.0:1783969364.018732:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+31:2392:x1870627074029952:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969364.018749:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969364.018757:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a00 expref: 31 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.018783:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a00 expref: 31 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.018809:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba55b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a00 expref: 31 pid: 6521 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.018829:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982253400) 00010000:00010000:3.0:1783969364.018835:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.018845:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.018852:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.018885:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969364.018939:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+30:2392:x1870627074029952:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 207us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969364.018948:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00010000:00010000:2.0:1783969364.019517:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969364.019528:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969364.019652:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1783969364.019813:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1783969364.019906:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1870627099268480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783969364.019961:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969364.019996:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea93c10240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969364.022160:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099268480 00000100:00100000:3.0:1783969364.022191:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099268480 00000100:00100000:3.0:1783969364.022280:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783969364.022291:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1870627099268480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783969364.022470:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1870627099268480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 180us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969364.022477:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783969364.022731:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1870627099268480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783969364.022925:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:0.0:1783969364.023017:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1870627099268608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783969364.023075:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969364.023105:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea926789c0 going to sleep for 11 seconds 00000100:00080000:2.0:1783969364.023183:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969364.023421:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099268608 00000100:00100000:1.0:1783969364.023426:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099268608 00000100:00100000:1.0:1783969364.023457:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783969364.023466:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1870627099268608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783969364.023599:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6525:x1870627099268608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (523us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783969364.023608:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783969364.023962:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1870627099268608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783969364.024014:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1783969364.024055:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.024066:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.024073:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.024080:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969364.024085:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.024092:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.024108:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982253400) 00010000:00010000:0.0:1783969364.024111:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783969364.024116:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969364.024121:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba5cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969364.024227:0:6525:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783969364.024295:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1783969364.024306:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426151924501ns, next at 427151922150ns, rc = 0 00000001:00080000:0.0:1783969364.024323:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:0.0:1783969364.024347:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982253400) 00010000:00010000:0.0:1783969364.024350:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783969364.024357:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53e00/0xea31253a47cba5b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a2a expref: 34 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969364.024487:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+33:12232:x1870627074029824:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 15153us (15349us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1783969364.024496:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000020:00080000:0.0:1783969364.024500:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783969364.029650:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969364.029806:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074030080 00000100:00100000:3.0:1783969364.029816:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074030080 00000100:00100000:3.0:1783969364.029868:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00100000:3.0:1783969364.029878:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+33:12232:x1870627074030080:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969364.029912:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969364.029939:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba5d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a31 expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.030000:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba5d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a31 expref: 34 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.030015:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba5d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a31 expref: 34 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.030031:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969364.030035:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969364.030038:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52c00, rc 0) 00000100:00100000:3.0:1783969364.030146:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+34:12232:x1870627074030080:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 267us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969364.030152:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00100000:2.0:1783969364.036367:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969364.037164:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074030336 00000100:00100000:1.0:1783969364.037177:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074030336 00000100:00100000:1.0:1783969364.037280:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:1.0:1783969364.037291:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+34:12232:x1870627074030336:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1783969364.037888:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+35:12232:x1870627074030336:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 595us (1526us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1783969364.037896:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1783969364.184763:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969364.184926:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074030592 00000100:00100000:1.0:1783969364.184937:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074030592 00000100:00100000:1.0:1783969364.185000:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:1.0:1783969364.185011:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+35:12242:x1870627074030592:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969364.185053:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969364.185077:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba5d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969364.185190:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783969364.185277:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba5d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a38 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.185288:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253200) 00010000:00010000:1.0:1783969364.185290:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783969364.185294:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba5d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a38 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.185309:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600c00, rc 0) 00000100:00100000:1.0:1783969364.185377:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+36:12242:x1870627074030592:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 369us (625us total) trans 4294967436 rc 301/301 00000100:00100000:1.0:1783969364.185423:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:2.0:1783969364.189792:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969364.192141:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074030720 00000100:00100000:3.0:1783969364.192171:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074030720 00000100:00100000:3.0:1783969364.192243:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:3.0:1783969364.192255:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+36:12242:x1870627074030720:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:3.0:1783969364.192426:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192444:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192456:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192469:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192477:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192483:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192570:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192578:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192585:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969364.192631:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192656:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192662:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192668:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192674:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969364.192678:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192696:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192709:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969364.192712:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969364.192716:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192723:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba5e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192735:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192741:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192746:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192757:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969364.192760:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192766:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192775:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253800) 00010000:00010000:3.0:1783969364.192777:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969364.192780:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192785:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba5ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192795:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192800:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192805:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192810:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969364.192813:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192819:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.192838:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969364.192840:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969364.192844:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.193594:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969364.193712:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+36:12242:x1870627074030720:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1457us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969364.193721:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:2.0:1783969364.208184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969364.208266:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074030976 00000100:00100000:0.0:1783969364.208277:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074030976 00000100:00100000:0.0:1783969364.208583:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1783969364.208595:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+36:12242:x1870627074030976:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969364.209648:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+37:12242:x1870627074030976:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 1050us (1467us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1783969364.209659:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:2.0:1783969364.267487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969364.268310:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074031232 00000100:00100000:3.0:1783969364.268324:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074031232 00000100:00100000:3.0:1783969364.268418:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:3.0:1783969364.268429:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+37:12246:x1870627074031232:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969364.268456:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969364.268479:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a3f expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.268557:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.268771:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.268786:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.268801:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.268824:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.268831:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269012:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269023:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269030:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969364.269040:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783969364.269118:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269125:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269132:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269138:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969364.269142:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269149:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269172:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969364.269175:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969364.269180:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269187:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba603 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269200:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269206:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269211:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269216:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969364.269219:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269225:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269233:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253800) 00010000:00010000:3.0:1783969364.269235:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969364.269237:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269242:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba60a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269288:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba5fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a3f expref: 40 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269301:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a3f expref: 39 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.269309:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969364.269311:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969364.269313:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52800, rc 0) 00000100:00100000:3.0:1783969364.269420:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+39:12246:x1870627074031232:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 953us (1904us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1783969364.269429:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:2.0:1783969364.279647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969364.279816:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074031360 00000100:00100000:1.0:1783969364.279827:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074031360 00000100:00100000:1.0:1783969364.279902:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:1.0:1783969364.279913:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+39:12246:x1870627074031360:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:1.0:1783969364.279989:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.280007:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.280018:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.280069:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.280076:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.280083:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.280089:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969364.280105:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.280113:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.280126:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969364.280129:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783969364.280133:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.280139:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba61f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969364.280215:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+39:12246:x1870627074031360:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 303us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969364.280223:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:2.0:1783969364.283873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969364.284477:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074031616 00000100:00100000:1.0:1783969364.284486:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074031616 00000100:00100000:1.0:1783969364.284538:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:1.0:1783969364.284574:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+39:12246:x1870627074031616:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1783969364.285842:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+40:12246:x1870627074031616:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 1264us (1972us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1783969364.285853:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1783969364.697649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969364.697927:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074031872 00000100:00100000:3.0:1783969364.697937:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074031872 00000100:00100000:3.0:1783969364.698000:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:3.0:1783969364.698009:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+40:12277:x1870627074031872:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:3.0:1783969364.698034:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969364.698054:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba626 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a46 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.698145:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba62d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.698156:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba62d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.698164:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba62d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969364.698180:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783969364.698267:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba626 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a46 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.698281:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba62d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a46 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.698287:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969364.698289:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969364.698291:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52400, rc 0) 00000100:00100000:3.0:1783969364.698355:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+42:12277:x1870627074031872:12345-192.168.201.34@tcp:101:cat.0 Request processed in 346us (715us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1783969364.698363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:2.0:1783969364.703495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969364.703548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969364.703640:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074032128 00000100:00100000:0.0:1783969364.703650:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074032128 00000100:00100000:0.0:1783969364.703727:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:0.0:1783969364.703742:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+42:12277:x1870627074032128:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:0.0:1783969364.704027:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+43:12277:x1870627074032128:12345-192.168.201.34@tcp:35:cat.0 Request processed in 286us (543us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1783969364.704035:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1783969364.704117:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074032256 00000100:00100000:1.0:1783969364.704122:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074032256 00000100:00100000:1.0:1783969364.704169:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1783969364.704176:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2119050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+43:2394:x1870627074032256:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969364.704188:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969364.704213:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cba62d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a46 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.704232:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969364.704237:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969364.704259:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2119050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+42:2394:x1870627074032256:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 85us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969364.704266:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1783969364.783178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969364.783268:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074032512 00000100:00100000:1.0:1783969364.783278:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074032512 00000100:00100000:1.0:1783969364.783354:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:1.0:1783969364.783364:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+42:12283:x1870627074032512:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:1.0:1783969364.783433:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969364.783436:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783969364.783467:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba593 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a1c expref: 42 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.783503:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969364.783508:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969364.783523:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba63b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a4d expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.783921:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.783936:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a3f expref: 42 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.783943:0:13769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.783976:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a3f expref: 42 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.783988:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a3f expref: 42 pid: 7749 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969364.784002:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099268736:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969364.784164:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419780 going to sleep for 11 seconds 00010000:00010000:1.0:1783969364.789493:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969364.794339:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099268736:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969364.794369:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969364.800074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969364.800650:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074032640 00000100:00100000:3.0:1783969364.800660:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074032640 00010000:00010000:3.0:1783969364.800747:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a3f expref: 43 pid: 7749 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969364.800794:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:3.0:1783969364.800804:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+43:2393:x1870627074032640:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969364.800821:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969364.800829:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a3f expref: 43 pid: 7749 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.800984:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a3f expref: 43 pid: 7749 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.801019:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba611 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a3f expref: 43 pid: 7749 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.801032:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969364.801036:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.801042:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.801047:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.801069:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969364.801107:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.801114:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969364.801136:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:3.0:1783969364.801182:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+42:2393:x1870627074032640:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 377us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969364.801189:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00010000:00010000:1.0:1783969364.801275:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba63b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a4d expref: 43 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.801305:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a4d expref: 42 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.801314:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969364.801317:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783969364.801319:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eac2176400, rc 0) 00000100:00100000:1.0:1783969364.801347:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+42:12283:x1870627074032512:12345-192.168.201.34@tcp:101:dd.0 Request processed in 17986us (18183us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1783969364.801354:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:2.0:1783969364.809741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969364.809873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074032768 00000100:00100000:1.0:1783969364.809884:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074032768 00000100:00100000:1.0:1783969364.809955:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:1.0:1783969364.809965:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+42:12283:x1870627074032768:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:1.0:1783969364.809995:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969364.810016:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba650 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.810081:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.810099:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.810110:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.810330:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba650 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a54 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.810348:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a54 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969364.810358:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969364.810361:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783969364.810364:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea9b600200, rc 0) 00000100:00100000:1.0:1783969364.810547:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+43:12283:x1870627074032768:12345-192.168.201.34@tcp:101:dd.0 Request processed in 582us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969364.810555:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:2.0:1783969364.822010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969364.822339:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074033024 00000100:00100000:3.0:1783969364.822350:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074033024 00000100:00100000:3.0:1783969364.822445:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:3.0:1783969364.822456:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+43:12283:x1870627074033024:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:3.0:1783969364.822702:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.822719:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.822731:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969364.822800:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1783969364.822824:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb3bf7b2 reply state 00000000daaaf643 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.822838:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969364.822846:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969364.822848:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969364.822851:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969364.822949:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+46:12283:x1870627074033024:12345-192.168.201.34@tcp:36:dd.0 Request processed in 494us (947us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1783969364.822957:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 170 00000020:00080000:3.0:1783969364.822962:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783969364.849284:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099268864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969364.849368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969364.849522:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099268864 00000100:00100000:2.0:1783969364.849529:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099268864 00000100:00100000:2.0:1783969364.849578:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783969364.849587:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099268864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783969364.849635:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783969364.850297:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099268864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 708us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969364.850307:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783969364.850500:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099268864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969365.219605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969365.219725:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074033152 00000100:00100000:3.0:1783969365.219735:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074033152 00000100:00100000:3.0:1783969365.219802:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:3.0:1783969365.219812:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+46:12297:x1870627074033152:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:3.0:1783969365.219837:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969365.219860:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba665 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a5b expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.219933:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.219949:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.219962:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.219982:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.219987:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.219991:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.220047:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.220054:0:7749:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a4d expref: 47 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.220059:0:7749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.220085:0:7749:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a4d expref: 47 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.220094:0:7749:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a4d expref: 47 pid: 13769 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969365.220104:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099268992:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969365.220260:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab92d96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969365.228492:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969365.228586:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074033408 00000100:00100000:0.0:1783969365.228596:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074033408 00000100:00100000:0.0:1783969365.228657:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1783969365.228695:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+48:6163:x1870627074033408:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783969365.229021:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+49:6163:x1870627074033408:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 328us (538us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1783969365.229029:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:3.0:1783969365.229515:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7749:1870627099268992:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969365.229543:0:7749:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969365.232417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969365.232492:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074033536 00000100:00100000:1.0:1783969365.232498:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074033536 00010000:00010000:1.0:1783969365.232531:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a4d expref: 49 pid: 13769 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969365.232577:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:1.0:1783969365.232584:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+49:2391:x1870627074033536:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969365.232598:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969365.232604:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a4d expref: 49 pid: 13769 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.232617:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a4d expref: 49 pid: 13769 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.232641:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba642 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a4d expref: 49 pid: 13769 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.232658:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969365.232661:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.232681:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.232689:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.232720:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969365.232784:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+48:2391:x1870627074033536:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 198us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.232793:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00010000:00010000:3.0:1783969365.232903:0:7749:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.232910:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969365.232953:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783969365.232956:0:7749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969365.232974:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.232984:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.232991:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.232996:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233001:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233004:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969365.233007:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233012:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233018:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969365.233025:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969365.233028:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233033:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba66c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233041:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233045:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233049:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233052:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969365.233053:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233056:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233061:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253800) 00010000:00010000:3.0:1783969365.233062:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969365.233064:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233067:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba673 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233088:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba665 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a5b expref: 48 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233105:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a5b expref: 47 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.233110:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969365.233111:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969365.233113:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53000, rc 0) 00000100:00100000:3.0:1783969365.233133:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+47:12297:x1870627074033152:12345-192.168.201.34@tcp:101:stat.0 Request processed in 13324us (13539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.233137:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:1.0:1783969365.299149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969365.299300:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074033792 00000100:00100000:0.0:1783969365.299316:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074033792 00000100:00100000:0.0:1783969365.299430:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:0.0:1783969365.299447:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+47:12303:x1870627074033792:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:0.0:1783969365.299527:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969365.299564:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53000/0xea31253a47cba67a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a5b expref: 47 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.299588:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:0.0:1783969365.299596:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969365.299815:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.299838:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.299850:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969365.299904:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:0.0:1783969365.299932:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b871b36 reply state 00000000b3be15f4 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.299945:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.299959:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:0.0:1783969365.299962:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783969365.299964:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969365.300064:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+49:12303:x1870627074033792:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 622us (931us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1783969365.300073:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 172 00000020:00080000:0.0:1783969365.300768:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783969365.360689:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099269120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969365.360786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969365.361031:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099269120 00000100:00100000:1.0:1783969365.361040:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099269120 00000100:00100000:1.0:1783969365.361090:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783969365.361100:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099269120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969365.361138:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969365.361193:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099269120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.361200:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783969365.361360:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099269120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969365.482485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969365.482599:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074033920 00000100:00100000:1.0:1783969365.482609:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074033920 00000100:00100000:1.0:1783969365.482706:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:1.0:1783969365.482717:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+49:12317:x1870627074033920:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:1.0:1783969365.482747:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969365.482876:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba688 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a62 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.482946:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.482961:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.482971:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.482982:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.482989:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483007:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483097:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483106:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483112:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969365.483156:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1783969365.483161:0:9027:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969365.483180:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483192:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483199:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483204:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483211:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483217:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969365.483221:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483234:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483246:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969365.483249:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969365.483254:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483259:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176400/0xea31253a47cba68f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483272:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483278:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483283:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483287:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969365.483290:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483295:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483301:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253800) 00010000:00010000:1.0:1783969365.483303:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969365.483306:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483320:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176600/0xea31253a47cba696 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483350:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600c00/0xea31253a47cba688 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a62 expref: 51 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483364:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a62 expref: 50 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.483370:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969365.483372:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969365.483375:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7c00, rc 0) 00000100:00100000:1.0:1783969365.483569:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+50:12317:x1870627074033920:12345-192.168.201.34@tcp:101:stat.0 Request processed in 853us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.483577:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:2.0:1783969365.598365:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969365.598601:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074034176 00000100:00100000:1.0:1783969365.598612:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074034176 00000100:00100000:1.0:1783969365.598703:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:1.0:1783969365.598714:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+50:12327:x1870627074034176:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969365.598736:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969365.598766:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba6a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a69 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969365.598869:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783969365.598976:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba6a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a69 expref: 52 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.599010:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253200) 00010000:00010000:1.0:1783969365.599013:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783969365.599019:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba6a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a69 expref: 52 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.599032:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6200, rc 0) 00000100:00100000:1.0:1783969365.599099:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+51:12327:x1870627074034176:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 386us (743us total) trans 4294967448 rc 301/301 00000100:00100000:1.0:1783969365.599106:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:2.0:1783969365.605553:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969365.605637:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074034432 00000100:00100000:0.0:1783969365.605648:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074034432 00000100:00100000:0.0:1783969365.605718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1783969365.605729:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+51:12327:x1870627074034432:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969365.605970:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+52:12327:x1870627074034432:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 241us (423us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1783969365.605978:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1783969365.747748:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969365.747895:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074034688 00000100:00100000:1.0:1783969365.747911:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074034688 00000100:00100000:1.0:1783969365.747985:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:1.0:1783969365.747996:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+52:12333:x1870627074034688:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1783969365.748022:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969365.748044:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba6b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a70 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.748154:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.748166:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a62 expref: 53 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.748173:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.748204:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a62 expref: 53 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.748229:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a62 expref: 53 pid: 9027 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969365.748244:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099269248:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969365.748346:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419000 going to sleep for 11 seconds 00000100:00100000:1.0:1783969365.752727:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099269248:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969365.752762:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969365.754231:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969365.754418:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074034816 00000100:00100000:0.0:1783969365.754425:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074034816 00010000:00010000:0.0:1783969365.754466:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a62 expref: 54 pid: 9027 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969365.754507:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:0.0:1783969365.754517:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+54:2392:x1870627074034816:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969365.754533:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969365.754541:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a62 expref: 54 pid: 9027 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.754554:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a62 expref: 54 pid: 9027 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.754587:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba69d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a62 expref: 54 pid: 9027 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.754603:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:0.0:1783969365.754607:0:7929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.754618:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.754626:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.754654:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969365.754768:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+53:2392:x1870627074034816:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 251us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969365.754777:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00010000:00010000:1.0:1783969365.756533:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.756544:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969365.756562:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1783969365.756713:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba6b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a70 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.756730:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a70 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.756740:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969365.756743:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783969365.756747:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7600, rc 0) 00000100:00100000:1.0:1783969365.756817:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+53:12333:x1870627074034688:12345-192.168.201.34@tcp:101:bash.0 Request processed in 8822us (9077us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1783969365.756843:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:2.0:1783969365.764000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969365.764089:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074035072 00000100:00100000:3.0:1783969365.764098:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074035072 00000100:00100000:3.0:1783969365.764168:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:3.0:1783969365.764179:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+53:12333:x1870627074035072:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:3.0:1783969365.764450:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.764469:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.764481:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969365.764524:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1783969365.764563:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c97ba92 reply state 0000000055fb45ac transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.764577:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.764901:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969365.764905:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969365.764909:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969365.765015:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+56:12333:x1870627074035072:12345-192.168.201.34@tcp:36:bash.0 Request processed in 835us (1021us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1783969365.765023:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 176 00000020:00080000:3.0:1783969365.765028:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783969365.770273:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969365.770967:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074035200 00000100:00100000:1.0:1783969365.770977:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074035200 00000100:00100000:1.0:1783969365.771066:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:1.0:1783969365.771074:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+56:12333:x1870627074035200:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1783969365.771094:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969365.771112:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba6ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a77 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.771184:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.771196:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a70 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.771202:0:13769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.771227:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a70 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.771237:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a70 expref: 57 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969365.771251:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099269376:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969365.771340:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969365.773206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969365.773261:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074035328 00000100:00100000:3.0:1783969365.773268:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074035328 00010000:00010000:3.0:1783969365.773477:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a70 expref: 58 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969365.773573:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:3.0:1783969365.773584:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+58:2392:x1870627074035328:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969365.773600:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969365.773607:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a70 expref: 58 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.773620:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a70 expref: 58 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.773642:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969365.773677:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.773688:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.773694:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.773714:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969365.773768:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+58:2392:x1870627074035328:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 186us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.773777:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00010000:00010000:1.0:1783969365.773936:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba6b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a70 expref: 57 pid: 6522 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969365.773959:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf92b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099269376:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969365.773978:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.773987:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.773993:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969365.774041:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783969365.774045:0:13769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969365.774063:0:13769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.774084:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba6ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a77 expref: 57 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.774093:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a77 expref: 56 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969365.774098:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969365.774100:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969365.774102:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6800, rc 0) 00000100:00100000:1.0:1783969365.775291:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+56:12333:x1870627074035200:12345-192.168.201.34@tcp:101:bash.0 Request processed in 4210us (5022us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.775302:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:2.0:1783969365.779059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969365.779224:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074035584 00000100:00100000:0.0:1783969365.779233:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074035584 00000100:00100000:0.0:1783969365.779291:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1783969365.779301:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+56:12333:x1870627074035584:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:0.0:1783969365.779936:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+57:12333:x1870627074035584:12345-192.168.201.34@tcp:35:bash.0 Request processed in 633us (885us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1783969365.779945:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00010000:00010000:1.0:1783969365.816259:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969365.873077:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969365.873102:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099269504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969365.873181:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969365.873909:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099269504 00000100:00100000:1.0:1783969365.873919:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099269504 00000100:00100000:1.0:1783969365.873993:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783969365.874005:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099269504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969365.874038:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783969365.874095:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099269504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.874102:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1783969365.874181:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969365.874309:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969365.874322:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099269632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969365.874377:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969365.874542:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099269504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969365.874625:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969365.874632:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099270016:0@lo:400:kworker.0 00000100:00100000:2.0:1783969365.874675:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969365.874732:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099270144:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.874841:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099269888:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.874873:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.874891:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969365.874896:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099269760:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.874929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.874962:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099269760 00000100:00100000:3.0:1783969365.874966:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099269760 00000100:00100000:3.0:1783969365.874996:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1783969365.875002:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099269760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875040:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3647:x1870627099269760:12345-0@lo:400:kworker.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.875047:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1783969365.875094:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099269760:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875138:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969365.875145:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98369ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099270272:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875173:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.875196:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099270016 00000100:00100000:3.0:1783969365.875200:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099270016 00000100:00100000:3.0:1783969365.875218:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099270272 00000100:00100000:3.0:1783969365.875219:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099270272 00000100:00100000:3.0:1783969365.875231:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783969365.875236:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099270016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875268:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099270016:12345-0@lo:400:kworker.0 Request processed in 32us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.875274:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783969365.875286:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783969365.875291:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099270272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875322:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099270272:12345-0@lo:400:kworker.0 Request processed in 31us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.875328:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783969365.875350:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98369ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099270272:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875402:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98369ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099270400:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.875466:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099270528:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875487:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.875524:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969365.875530:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099270656:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875564:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.875598:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969365.875606:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099270784:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.875674:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099270912:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.875697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.875724:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099269888 00000100:00100000:3.0:1783969365.875729:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099269888 00000100:00100000:2.0:1783969365.875853:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969365.876943:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099270656 00000100:00100000:0.0:1783969365.876951:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099270656 00000100:00100000:0.0:1783969365.876996:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099270784 00000100:00100000:0.0:1783969365.877011:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099270784 00000100:00100000:0.0:1783969365.877035:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783969365.877043:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099270656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.877105:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099270656:12345-0@lo:400:kworker.0 Request processed in 63us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969365.877112:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783969365.877128:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783969365.877134:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099270784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.877168:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099270784:12345-0@lo:400:kworker.0 Request processed in 35us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969365.877174:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1783969365.877190:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969365.877227:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099270656:0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.877258:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099270784:0@lo:400:kworker.0 00000100:00100000:1.0:1783969365.877334:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099269632 00000100:00100000:1.0:1783969365.877339:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099269632 00000100:00100000:1.0:1783969365.877376:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783969365.877401:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099269632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969365.877419:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783969365.877462:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099269632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.877469:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1783969365.877483:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969365.877510:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099269632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969365.884154:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099270016:0@lo:400:kworker.0 00000100:00100000:2.0:1783969365.884283:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099271040:0@lo:400:kworker.0 00000100:00100000:2.0:1783969365.884341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.884469:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099270400 00000100:00100000:3.0:1783969365.884477:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099270400 00000100:00080000:3.0:1783969365.884505:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969365.884519:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099270528 00000100:00100000:3.0:1783969365.884522:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099270528 00000100:00100000:3.0:1783969365.884560:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099270912 00000100:00100000:3.0:1783969365.884563:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099270912 00000100:00100000:3.0:1783969365.884576:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099270144 00000100:00100000:3.0:1783969365.884579:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099270144 00000100:00100000:3.0:1783969365.884594:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783969365.884602:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099269888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.884675:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099269888:12345-0@lo:400:kworker.0 Request processed in 58us (9785us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.884683:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783969365.884701:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1783969365.884707:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099270528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.884758:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099270528:12345-0@lo:400:kworker.0 Request processed in 42us (9260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.884765:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1783969365.884777:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1783969365.884798:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099270912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.884829:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099270912:12345-0@lo:400:kworker.0 Request processed in 32us (9131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.884835:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1783969365.884847:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1783969365.884853:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099270144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.884882:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099270144:12345-0@lo:400:kworker.0 Request processed in 29us (9029us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.884888:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00080000:3.0:1783969365.884903:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969365.884905:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969365.884931:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1783969365.884937:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099270400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.884966:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099270400:12345-0@lo:400:kworker.0 Request processed in 29us (9538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.884971:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1783969365.885035:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099271168:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.885067:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.885098:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099270144:0@lo:400:kworker.0 00010000:00080000:2.0:1783969365.885472:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983699c00 x1870627099270528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969365.885484:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099270528:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.885610:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099271040 00000100:00100000:3.0:1783969365.885616:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099271040 00000100:00080000:2.0:1783969365.885736:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969365.885766:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1783969365.885776:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099271040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969365.885831:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099271040:12345-0@lo:400:kworker.0 Request processed in 57us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969365.885838:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00080000:2.0:1783969365.885865:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983d23480 x1870627099271040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969365.885874:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099271040:0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.888513:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099270912:0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.888534:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98369ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099270400:0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.888546:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099269888:0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.888587:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099271168 00000100:00100000:0.0:1783969365.888593:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099271168 00000100:00100000:0.0:1783969365.888642:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783969365.888651:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099271168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.889232:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099271168:12345-0@lo:400:kworker.0 Request processed in 579us (4161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969365.889241:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783969365.893073:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099271168:0@lo:400:kworker.0 00000100:00100000:2.0:1783969365.902009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969365.902094:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074035840 00000100:00100000:3.0:1783969365.902104:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074035840 00000100:00100000:3.0:1783969365.902170:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 178 00000100:00100000:3.0:1783969365.902180:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+57:12343:x1870627074035840:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969365.902217:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969365.902237:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba6dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a7e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969365.902356:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783969365.902627:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba6dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a7e expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.902643:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253200) 00010000:00010000:3.0:1783969365.902646:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969365.902651:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba6dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a7e expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.902685:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53c00, rc 0) 00000100:00100000:3.0:1783969365.902743:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+58:12343:x1870627074035840:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 564us (745us total) trans 4294967454 rc 301/301 00000100:00100000:3.0:1783969365.902858:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 178 00000100:00100000:2.0:1783969365.907350:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969365.907501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074035968 00000100:00100000:0.0:1783969365.907512:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074035968 00000100:00100000:0.0:1783969365.907575:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:0.0:1783969365.907586:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+58:12343:x1870627074035968:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1783969365.907895:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.907914:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.907929:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.907943:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.907951:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.907958:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908057:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908066:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908074:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969365.908121:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908148:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908154:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908162:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908168:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969365.908171:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908179:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908191:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969365.908194:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969365.908199:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908205:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba6ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908218:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908223:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908229:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908240:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969365.908243:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908248:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908256:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253800) 00010000:00010000:0.0:1783969365.908258:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969365.908261:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908266:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797e00/0xea31253a47cba6f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908303:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908310:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908316:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908321:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969365.908323:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908329:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908348:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:0.0:1783969365.908350:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969365.908353:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.908358:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba6f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969365.908479:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+58:12343:x1870627074035968:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 893us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969365.908487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:2.0:1783969365.912676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969365.912903:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074036224 00000100:00100000:1.0:1783969365.912913:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074036224 00000100:00100000:1.0:1783969365.912975:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:1.0:1783969365.912986:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+58:12343:x1870627074036224:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1783969365.913236:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+59:12343:x1870627074036224:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 251us (585us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1783969365.913245:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1783969365.970236:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969365.970369:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074036480 00000100:00100000:3.0:1783969365.970378:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074036480 00000100:00100000:3.0:1783969365.970484:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:3.0:1783969365.970494:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+59:12346:x1870627074036480:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969365.970520:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969365.970542:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba6ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a85 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.970606:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.970635:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.970644:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.970654:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.970670:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.970675:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.970959:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba714 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.970970:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.970977:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969365.970985:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783969365.971051:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971055:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971060:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971069:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969365.971072:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971077:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971087:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969365.971089:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969365.971091:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971096:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba706 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971105:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971109:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971112:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971115:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969365.971117:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971120:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971131:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253800) 00010000:00010000:3.0:1783969365.971132:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969365.971134:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971137:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba70d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971164:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba6ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a85 expref: 62 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971172:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba714 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a85 expref: 61 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.971177:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969365.971178:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969365.971180:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52a00, rc 0) 00000100:00100000:3.0:1783969365.971235:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+61:12346:x1870627074036480:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 744us (1011us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1783969365.971240:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:2.0:1783969365.977420:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969365.977464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969365.977587:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074036608 00000100:00100000:3.0:1783969365.977596:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074036608 00000100:00100000:3.0:1783969365.977645:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1783969365.977652:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+61:2394:x1870627074036608:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969365.977678:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969365.977709:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba714 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a85 expref: 61 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969365.977745:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969365.977750:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969365.977813:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+60:2394:x1870627074036608:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 159us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969365.977821:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1783969365.977890:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074036736 00000100:00100000:0.0:1783969365.977894:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074036736 00000100:00100000:0.0:1783969365.977931:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:0.0:1783969365.977938:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+60:12346:x1870627074036736:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1783969365.977993:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.978008:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.978020:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.978055:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.978061:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.978077:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.978082:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969365.978087:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.978094:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.978102:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:0.0:1783969365.978104:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969365.978108:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969365.978114:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba722 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969365.978606:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+60:12346:x1870627074036736:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 667us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969365.978614:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:2.0:1783969365.986941:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969365.987906:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074036992 00000100:00100000:1.0:1783969365.987919:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074036992 00000100:00100000:1.0:1783969365.987984:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1783969365.987996:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+60:12346:x1870627074036992:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1783969365.988281:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+61:12346:x1870627074036992:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 281us (1344us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1783969365.988288:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:2.0:1783969366.203491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.203585:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074037248 00000100:00100000:3.0:1783969366.203594:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074037248 00000100:00100000:3.0:1783969366.203688:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:3.0:1783969366.203700:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+61:12364:x1870627074037248:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:3.0:1783969366.203727:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969366.203863:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba729 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a8c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.203978:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba730 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.203995:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba730 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.204009:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba730 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969366.204020:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783969366.204135:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba729 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a8c expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.204151:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba730 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a8c expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.204176:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969366.204179:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783969366.204182:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53c00, rc 0) 00000100:00100000:3.0:1783969366.204256:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12364:x1870627074037248:12345-192.168.201.34@tcp:101:cat.0 Request processed in 558us (776us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1783969366.204263:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00080000:2.0:1783969366.204337:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969366.257821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969366.258204:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074037376 00000100:00100000:1.0:1783969366.258216:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074037376 00000100:00100000:1.0:1783969366.258279:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 183 00000100:00100000:1.0:1783969366.258290:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12365:x1870627074037376:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969366.258315:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969366.258335:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cba73e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a93 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.258439:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7a00/0xea31253a47cba745 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.258455:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7a00/0xea31253a47cba745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.258466:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7a00/0xea31253a47cba745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969366.258508:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783969366.258512:0:9027:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969366.258530:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7a00/0xea31253a47cba745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.258556:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cba73e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a93 expref: 65 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.258592:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7a00/0xea31253a47cba745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a93 expref: 64 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.258601:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969366.258604:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969366.258608:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7a00, rc 0) 00000100:00100000:1.0:1783969366.258702:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12365:x1870627074037376:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 413us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969366.258709:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 183 00000100:00100000:1.0:1783969366.274482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969366.274591:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074037760 00000100:00100000:0.0:1783969366.274601:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074037760 00000100:00100000:0.0:1783969366.274684:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1783969366.274697:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12365:x1870627074037760:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969366.275018:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12365:x1870627074037760:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 323us (545us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1783969366.275031:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1783969366.278896:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969366.279171:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074037888 00000100:00100000:0.0:1783969366.279181:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074037888 00000100:00100000:0.0:1783969366.279250:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1783969366.279260:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12365:x1870627074037888:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:0.0:1783969366.279279:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783969366.279306:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba6d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a77 expref: 65 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.279327:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cba730 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a8c expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.279339:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52c00/0xea31253a47cba5d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a31 expref: 63 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.279348:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:0.0:1783969366.279352:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969366.279466:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+62:12365:x1870627074037888:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 207us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.279474:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1783969366.290861:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.291015:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074038016 00000100:00100000:3.0:1783969366.291027:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074038016 00000100:00100000:3.0:1783969366.291101:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 184 00000100:00100000:3.0:1783969366.291114:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+62:12365:x1870627074038016:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:3.0:1783969366.291273:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.291299:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.291316:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969366.291466:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1783969366.291575:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+62:12365:x1870627074038016:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 459us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.291586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 184 00000100:00100000:1.0:1783969366.326141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.326219:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074038144 00000100:00100000:3.0:1783969366.326228:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074038144 00000100:00100000:3.0:1783969366.326327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:3.0:1783969366.326338:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9836dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+62:12367:x1870627074038144:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969366.326374:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969366.326434:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba753 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303a9a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326508:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326524:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326535:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326547:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326554:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326560:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326635:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326644:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326664:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969366.326715:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783969366.326723:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969366.326749:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326759:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326764:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326769:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326773:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326777:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.326780:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326784:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326793:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969366.326795:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969366.326798:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326801:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba75a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326809:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326819:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326823:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326826:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.326827:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326831:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326836:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253800) 00010000:00010000:3.0:1783969366.326838:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969366.326840:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326843:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba761 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326863:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba753 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a9a expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326872:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a9a expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.326877:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969366.326879:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969366.326884:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53600, rc 0) 00000100:00100000:3.0:1783969366.326956:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9836dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12367:x1870627074038144:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 619us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.326963:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 185 00000004:00080000:2.0:1783969366.385215:0:8839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428512829884ns, next at 429512827157ns, rc = 0 00000100:00100000:1.0:1783969366.385336:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969366.385359:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099271296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969366.385448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969366.385733:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099271296 00000100:00100000:3.0:1783969366.385748:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099271296 00000100:00100000:3.0:1783969366.385816:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783969366.385826:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099271296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969366.385855:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783969366.385902:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099271296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.385910:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1783969366.385975:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969366.386295:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099271296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969366.386601:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099271424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969366.386636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969366.386875:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099271424 00000100:00100000:2.0:1783969366.386882:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099271424 00000100:00100000:2.0:1783969366.386920:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783969366.386927:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099271424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969366.386942:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783969366.386983:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099271424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969366.387002:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783969366.387102:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099271424:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1783969366.453483:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969366.453491:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969366.453510:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1783969366.453516:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969366.453641:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98369b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099271552:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783969366.457484:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab92d9240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969366.462350:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98369b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099271552:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783969366.467985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.473589:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074038272 00000100:00100000:3.0:1783969366.473605:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074038272 00000100:00100000:3.0:1783969366.473685:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:3.0:1783969366.473699:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12378:x1870627074038272:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783969366.473810:0:9027:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783969366.473950:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12378:x1870627074038272:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 254us (5975us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.473971:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:2.0:1783969366.492213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.492281:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074038400 00000100:00100000:3.0:1783969366.492291:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074038400 00000100:00100000:3.0:1783969366.492352:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:3.0:1783969366.492360:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12378:x1870627074038400:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783969366.492448:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492466:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492479:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492544:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492551:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492555:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492579:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492587:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492593:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969366.492645:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783969366.492657:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969366.492671:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492683:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492694:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492700:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492706:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.492711:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492855:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492870:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:3.0:1783969366.492873:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969366.492877:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492883:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba76f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.492896:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493044:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493050:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493055:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.493058:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493065:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493073:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff93ea911e6f00) 00010000:00010000:3.0:1783969366.493076:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969366.493078:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493084:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba776 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493098:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493104:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493110:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493115:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.493123:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493129:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493137:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969366.493139:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969366.493142:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.493148:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba77d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.493324:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12378:x1870627074038400:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 961us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.493333:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:2.0:1783969366.501517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.501593:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074038656 00000100:00100000:3.0:1783969366.501602:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074038656 00000100:00100000:3.0:1783969366.501670:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:3.0:1783969366.501682:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12378:x1870627074038656:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969366.501712:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969366.501744:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba784 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303aa1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.501854:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.501870:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.501891:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969366.501903:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783969366.501977:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.501985:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.501991:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.501996:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.502000:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.502007:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.502019:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969366.502022:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969366.502026:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.502032:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba78b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.502068:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba784 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aa1 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.502088:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:3.0:1783969366.502091:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969366.502095:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba784 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aa1 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.502104:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52600, rc 0) 00000100:00100000:3.0:1783969366.502166:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12378:x1870627074038656:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 486us (659us total) trans 4294967460 rc 301/301 00000100:00100000:3.0:1783969366.502174:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:2.0:1783969366.518678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969366.518736:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074038784 00000100:00100000:2.0:1783969366.518753:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074038784 00000100:00100000:2.0:1783969366.518816:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:2.0:1783969366.518827:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12378:x1870627074038784:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783969366.518867:0:13769:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783969366.518990:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12378:x1870627074038784:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 164us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969366.518998:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:3.0:1783969366.529323:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969366.529520:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074039040 00000100:00100000:1.0:1783969366.529529:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074039040 00000100:00100000:1.0:1783969366.529585:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:1.0:1783969366.529596:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98369b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12378:x1870627074039040:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969366.529616:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969366.529619:0:7749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783969366.529663:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7a00/0xea31253a47cba745 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a93 expref: 64 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.529679:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969366.529686:0:7749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969366.529698:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cba799 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303aa8 expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783969366.530062:0:7749:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1783969366.530191:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cba7a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.530208:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cba7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.530217:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cba7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.530260:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cba799 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aa8 expref: 66 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.530274:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cba7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aa8 expref: 65 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.530281:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93e982253d00) 00010000:00010000:1.0:1783969366.530284:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969366.530286:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6400, rc 0) 00000100:00100000:1.0:1783969366.533397:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98369b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12378:x1870627074039040:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3774us (4055us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1783969366.533431:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:2.0:1783969366.543703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.547353:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074039296 00000100:00100000:3.0:1783969366.547369:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074039296 00000100:00100000:3.0:1783969366.547451:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:3.0:1783969366.547462:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12378:x1870627074039296:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969366.547522:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969366.547552:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cba7a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aa8 expref: 65 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547569:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93e982253d00) 00010000:00010000:3.0:1783969366.547579:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969366.547604:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547618:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547640:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547715:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547724:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547731:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547773:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547781:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547789:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547794:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.547799:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547807:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547815:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969366.547818:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969366.547822:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547834:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba7ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547844:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547850:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547856:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547861:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.547864:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547870:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547878:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x52b8f43d (ffff93ea911e6f00) 00010000:00010000:3.0:1783969366.547881:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969366.547883:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.547889:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x52b8f43d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.547992:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12378:x1870627074039296:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 530us (4296us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783969366.547999:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:3.0:1783969366.555044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.555088:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074039424 00000100:00100000:3.0:1783969366.555109:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074039424 00000100:00100000:3.0:1783969366.562978:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 192 00000100:00100000:3.0:1783969366.563003:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12378:x1870627074039424:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969366.563028:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969366.563053:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303aaf expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.563092:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.563106:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.563119:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.563243:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aaf expref: 66 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.563263:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aaf expref: 65 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.563273:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:3.0:1783969366.563276:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783969366.563279:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53400, rc 0) 00000100:00100000:3.0:1783969366.563354:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12378:x1870627074039424:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 365us (8320us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.563371:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 192 00000100:00100000:3.0:1783969366.570633:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969366.571245:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074039680 00000100:00100000:2.0:1783969366.571258:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074039680 00000100:00100000:2.0:1783969366.571325:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:2.0:1783969366.571336:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12378:x1870627074039680:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783969366.571445:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.571464:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.571476:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969366.571673:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1783969366.571697:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 428699315290ns, next at 429699299560ns, rc = 0 00000004:00010000:2.0:1783969366.571878:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b97dd94 reply state 00000000d742d035 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.571892:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.571900:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:2.0:1783969366.571913:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783969366.571916:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969366.572121:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+67:12378:x1870627074039680:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 785us (1496us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1783969366.572129:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:1.0:1783969366.584366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.585059:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074039808 00000100:00100000:3.0:1783969366.585071:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074039808 00000100:00100000:3.0:1783969366.585135:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:3.0:1783969366.585145:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+67:12378:x1870627074039808:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969366.585171:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969366.585193:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303ab6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.585254:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ab6 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.585270:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ab6 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.585289:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:3.0:1783969366.585293:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969366.585297:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53200, rc 0) 00000100:00100000:3.0:1783969366.585355:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+68:12378:x1870627074039808:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 211us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.585362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:0.0:1783969366.595957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969366.596286:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074039936 00000100:00100000:1.0:1783969366.596296:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074039936 00000100:00100000:1.0:1783969366.596373:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1783969366.596405:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+6:2392:x1870627074039936:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783969366.596627:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2392:x1870627074039936:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 244us (679us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783969366.596635:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00080000:3.0:1783969366.597067:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969366.601095:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969366.601182:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074040192 00000100:00100000:0.0:1783969366.601193:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074040192 00000100:00100000:0.0:1783969366.601258:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:0.0:1783969366.601268:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98369bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+68:12378:x1870627074040192:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783969366.601530:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98369bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+69:12378:x1870627074040192:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 263us (443us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1783969366.601539:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1783969366.605148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.605280:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074040448 00000100:00100000:3.0:1783969366.605292:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074040448 00000100:00100000:3.0:1783969366.605355:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:3.0:1783969366.605412:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+69:12378:x1870627074040448:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783969366.605533:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+69:12378:x1870627074040448:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 155us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.605541:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:3.0:1783969366.612175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969366.612357:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074040576 00000100:00100000:2.0:1783969366.612368:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074040576 00000100:00100000:2.0:1783969366.612452:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:2.0:1783969366.612464:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+69:12378:x1870627074040576:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969366.612487:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969366.612510:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba7d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303abd expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.612583:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba7df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.612598:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.612627:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969366.612683:0:7749:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969366.612705:0:7749:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.612897:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba7d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303abd expref: 71 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.612916:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba7df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303abd expref: 70 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.612925:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:2.0:1783969366.612929:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783969366.612932:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae000, rc 0) 00000100:00100000:2.0:1783969366.612984:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+70:12378:x1870627074040576:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 522us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969366.612992:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:1.0:1783969366.642182:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969366.642227:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074040704 00000100:00100000:1.0:1783969366.642237:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074040704 00000100:00100000:1.0:1783969366.642297:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1783969366.642308:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074040704:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969366.642327:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969366.642351:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303ac4 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783969366.642395:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a553655, blocks: 0x0 00010000:00010000:1.0:1783969366.642417:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1783969366.642422:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969366.642432:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ac4 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.642467:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ac4 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.642481:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6c00, rc 0) 00000100:00100000:1.0:1783969366.642535:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2393:x1870627074040704:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 230us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969366.642542:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1783969366.671192:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.674967:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074040960 00000100:00100000:3.0:1783969366.674985:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074040960 00000100:00100000:3.0:1783969366.675056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 197 00000100:00100000:3.0:1783969366.675065:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+70:12378:x1870627074040960:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783969366.675176:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+70:12378:x1870627074040960:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 111us (3994us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.675183:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 197 00000100:00100000:3.0:1783969366.686521:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969366.686682:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074041088 00000100:00100000:0.0:1783969366.686694:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074041088 00000100:00100000:0.0:1783969366.686768:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:0.0:1783969366.686780:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98369a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:12378:x1870627074041088:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969366.686799:0:9974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969366.686820:0:9974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303acb expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.686855:0:9974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ac4 expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.686867:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969366.686872:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969366.686878:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 9 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.686917:0:9974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ac4 expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.686931:0:9974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ac4 expref: 9 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.686946:0:9974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9974:1870627099271680:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969366.687049:0:9974:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235480 going to sleep for 11 seconds 00000100:00100000:1.0:1783969366.690583:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969366.690707:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074041216 00000100:00100000:2.0:1783969366.690715:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074041216 00010000:00010000:2.0:1783969366.690757:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ac4 expref: 10 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969366.690801:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:2.0:1783969366.690811:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab211ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2392:x1870627074041216:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969366.690827:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969366.690865:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ac4 expref: 10 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.690871:0:9974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9974:1870627099271680:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969366.690885:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ac4 expref: 10 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.691068:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081fb4e91/0xea31253a47cba7e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ac4 expref: 10 pid: 8439 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.691081:0:9974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 9 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.691087:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969366.691096:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969366.691111:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 9 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.691122:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 9 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.691149:0:9974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796400, rc 0) 00010000:00010000:2.0:1783969366.691179:0:7929:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 9 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969366.691195:0:7929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983f8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7929:1870627099271808:192.168.201.34@tcp:105: 00000100:00100000:0.0:1783969366.691214:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98369a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+9:12378:x1870627074041088:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 4435us (4702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.691222:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1783969366.691253:0:7929:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea862f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1783969366.696114:0:7929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983f8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7929:1870627099271808:192.168.201.34@tcp:105: 00010000:00010000:0.0:1783969366.696147:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969366.696261:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab211ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2392:x1870627074041216:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 5450us (5688us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.696274:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:2.0:1783969366.699617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969366.700034:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074041344 00000100:00100000:1.0:1783969366.700043:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074041344 00002000:00100000:1.0:1783969366.700089:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff93e983f8dc00 x1870627074041344/t0(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:262/0 lens 504/0 e 0 to 0 dl 1783969377 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783969366.700101:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93e983f8dc00 with x1870627074041344 ext(0->8) 00002000:00010000:1.0:1783969366.700107:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93e983f8dc00 00000100:00100000:1.0:1783969366.700135:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:1.0:1783969366.700143:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2394:x1870627074041344:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783969366.702138:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2394:x1870627074041344:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 1985us (2522us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783969366.702152:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00002000:00100000:0.0:1783969366.702163:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff93e983f8dc00 x1870627074041344/t4294967315(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:262/0 lens 504/448 e 0 to 0 dl 1783969377 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783969366.702173:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93e983f8dc00 with x1870627074041344 ext(0->8) 00002000:00010000:0.0:1783969366.702180:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93e983f8dc00 00000100:00100000:1.0:1783969366.705266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.705542:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074041472 00000100:00100000:3.0:1783969366.705551:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074041472 00000100:00100000:3.0:1783969366.705619:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:3.0:1783969366.705630:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e981a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+70:12378:x1870627074041472:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783969366.712983:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:0.0:1783969366.713000:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:0.0:1783969366.713023:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1783969366.713078:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1783969366.713086:0:6500:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ea86064540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1783969366.713092:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab73b4000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ea86064e40 00000020:00080000:0.0:1783969366.713095:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab73b4200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93e98367a200 00000100:00100000:2.0:1783969366.713140:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099271936:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1783969366.713157:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1783969366.713202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783969366.713219:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1783969366.713237:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099271936 00000100:00100000:0.0:1783969366.713245:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099271936 00010000:00010000:1.0:1783969366.713552:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713565:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713573:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713587:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafe00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969366.713606:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713614:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713631:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93e982170700) 00010000:00010000:1.0:1783969366.713633:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969366.713639:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713654:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafe00/0xea31253a47cba50e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713681:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713687:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713693:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713697:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafa00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969366.713699:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713705:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713724:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969366.713726:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969366.713729:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713745:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba515 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713759:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713764:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713770:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713776:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eac2176800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969366.713779:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713785:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713793:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253800) 00010000:00010000:1.0:1783969366.713795:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969366.713799:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713804:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176800/0xea31253a47cba554 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713832:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713838:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713844:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713849:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969366.713851:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713857:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713865:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969366.713868:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969366.713871:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713877:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cba65e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713887:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713892:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713898:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713909:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969366.713913:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713919:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713928:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969366.713930:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969366.713933:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713937:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba681 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713949:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713954:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713960:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713964:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969366.713966:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713971:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713989:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:1.0:1783969366.713990:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969366.713993:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.713998:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cba6c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.714009:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.714015:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.714020:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.714025:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969366.714027:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.714032:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.714039:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:1.0:1783969366.714041:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783969366.714044:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.714049:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba7ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.714426:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099272064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783969366.714481:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969366.714698:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099272064 00000100:00100000:0.0:1783969366.714704:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099272064 00000100:00100000:0.0:1783969366.714800:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783969366.714811:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099271936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783969366.714824:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783969366.714846:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1870627099272064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783969366.714868:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1783969366.714901:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a553652, atime: 0x0, ctime: 0x6a553652, blocks: 0x8 00010000:00010000:2.0:1783969366.714920:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.714938:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=428s v=(0 0) 00002000:00010000:0.0:1783969366.714939:0:14243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:2.0:1783969366.714945:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1783969366.714945:0:14243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783969365 00002000:00010000:0.0:1783969366.714949:0:14243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783969366.714953:0:14243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1783969365 -> 1783969365 00010000:00010000:2.0:1783969366.714956:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969366.714956:0:14243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783969366.714977:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.714988:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.714996:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.715005:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1870627099271936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (1800us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783969366.715012:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00010000:2.0:1783969366.715017:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783969366.715054:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93e983f8e300/2, rc 0, transno 4294967316 00000100:00100000:0.0:1783969366.715061:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099271936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783969366.715134:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1870627099272064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 292us (652us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783969366.715143:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:2.0:1783969366.715165:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969366.715172:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.715175:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e981a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+19:12378:x1870627074041472:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 9543us (9914us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.715189:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 198 00010000:00010000:2.0:1783969366.715201:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daee00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969366.715206:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.715214:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.715229:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.715237:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fc79d0d/0xea31253a47cba7f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969366.715256:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969366.715258:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969366.715260:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783969366.715288:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93e983699c00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1783969366.715294:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099272064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783969366.717966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969366.718087:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074041600 00000100:00100000:0.0:1783969366.718097:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074041600 00000100:00100000:0.0:1783969366.718187:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:0.0:1783969366.718197:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2394:x1870627074041600:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783969366.719969:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1783969366.719981:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1783969366.720521:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2394:x1870627074041600:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 2319us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.720544:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:2.0:1783969366.726562:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.727602:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074041856 00000100:00100000:3.0:1783969366.727617:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074041856 00000100:00100000:3.0:1783969366.728266:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:3.0:1783969366.728281:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+19:12378:x1870627074041856:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969366.728362:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969366.728422:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba7df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303abd expref: 19 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.728445:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:3.0:1783969366.728450:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969366.728487:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.728503:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.728515:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969366.728663:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017404aee reply state 0000000096abf8b5 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.728686:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.728693:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:3.0:1783969366.728695:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969366.728698:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969366.728832:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+20:12378:x1870627074041856:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 553us (2278us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1783969366.728840:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:1.0:1783969366.735769:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.735852:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074041984 00000100:00100000:3.0:1783969366.735861:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074041984 00000100:00100000:3.0:1783969366.735922:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:3.0:1783969366.735947:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2394:x1870627074041984:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783969366.736105:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1783969366.736109:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1783969365 -> 1783969364 00002000:00010000:3.0:1783969366.736111:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783969363 00002000:00010000:3.0:1783969366.736113:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1783969365 -> 1783969364 00002000:00010000:3.0:1783969366.736116:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1783969366.736184:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2394:x1870627074041984:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 238us (423us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1783969366.736192:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:1.0:1783969366.739722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.739855:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074042240 00000100:00100000:3.0:1783969366.739867:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074042240 00000100:00100000:3.0:1783969366.739943:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:3.0:1783969366.739954:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+20:12378:x1870627074042240:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783969366.740028:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.740045:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aaf expref: 20 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.740054:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.740091:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aaf expref: 20 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.740105:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aaf expref: 20 pid: 13769 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.740142:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98369aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099272192:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969366.740241:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab92d9240 going to sleep for 11 seconds 00000100:00100000:0.0:1783969366.745072:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98369aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099272192:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969366.745104:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.747701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.748000:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074042368 00000100:00100000:3.0:1783969366.748009:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074042368 00010000:00010000:3.0:1783969366.748049:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aaf expref: 21 pid: 13769 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.748093:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:3.0:1783969366.748102:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+21:2392:x1870627074042368:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969366.748118:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969366.748126:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aaf expref: 21 pid: 13769 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.748138:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aaf expref: 21 pid: 13769 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.748166:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba7c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aaf expref: 21 pid: 13769 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.748181:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:3.0:1783969366.748185:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.748252:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.748273:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.748307:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969366.748359:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+20:2392:x1870627074042368:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 257us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.748367:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 89 00010000:00010000:0.0:1783969366.752757:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.752777:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.752826:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.752834:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.752840:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.752847:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969366.752852:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.752860:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.752879:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:0.0:1783969366.752882:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783969366.752899:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.752920:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52600/0xea31253a47cba802 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.753042:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:12378:x1870627074042240:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 13083us (13324us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783969366.753054:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:0.0:1783969366.774979:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969366.775067:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074042496 00000100:00100000:1.0:1783969366.775079:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074042496 00000100:00100000:1.0:1783969366.775145:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1783969366.775157:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2393:x1870627074042496:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783969366.775205:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.775227:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 8 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.775237:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969366.775242:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783969366.775247:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.775286:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 8 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.775300:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 8 pid: 9974 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969366.775313:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1870627099272320:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969366.775438:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419180 going to sleep for 11 seconds 00000100:00100000:1.0:1783969366.780699:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969366.780982:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074042624 00000100:00100000:0.0:1783969366.780991:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074042624 00010000:00010000:0.0:1783969366.781033:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 9 pid: 9974 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.781072:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:0.0:1783969366.781082:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2391:x1870627074042624:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969366.781100:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969366.781125:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 9 pid: 9974 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.781139:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 9 pid: 9974 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.781166:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969366.781171:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969366.781177:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.781206:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.781229:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969366.781283:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2391:x1870627074042624:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 202us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.781290:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 90 00010000:00010000:3.0:1783969366.781765:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cba7ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303acb expref: 8 pid: 9974 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.781783:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1870627099272320:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969366.781805:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.781815:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.781821:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.781843:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.781850:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.781870:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.781877:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de7200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969366.781880:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.781888:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.781900:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.781907:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c306b7/0xea31253a47cba809 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.781973:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074042496:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 6818us (7003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.781982:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1783969366.785937:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969366.786805:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074042880 00000100:00100000:0.0:1783969366.786828:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074042880 00000100:00100000:1.0:1783969366.786947:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00100000:1.0:1783969366.786959:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+19:12378:x1870627074042880:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783969366.787056:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.787076:0:9027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a54 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.787086:0:9027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.787124:0:9027:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a54 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.787138:0:9027:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a54 expref: 19 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969366.787153:0:9027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099272448:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969366.787246:0:9027:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969366.793819:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.793893:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074043008 00000100:00100000:3.0:1783969366.793902:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074043008 00010000:00010000:3.0:1783969366.793943:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a54 expref: 20 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.793991:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:3.0:1783969366.794018:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+20:2391:x1870627074043008:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969366.794034:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969366.794042:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a54 expref: 20 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.794056:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a54 expref: 20 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.794081:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969366.794087:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.794097:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.794105:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.794124:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969366.794186:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+20:2391:x1870627074043008:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 169us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969366.794194:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00010000:00010000:1.0:1783969366.794751:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600200/0xea31253a47cba657 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a54 expref: 19 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969366.794770:0:9027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099272448:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969366.794790:0:9027:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.794807:0:9027:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.794813:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.794980:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.794993:0:9027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ab6 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.795001:0:9027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.795032:0:9027:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ab6 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969366.795047:0:9027:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ab6 expref: 19 pid: 6521 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969366.795060:0:9027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099272576:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969366.795132:0:9027:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969366.802095:0:9027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099272576:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969366.802123:0:9027:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969366.811120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969366.811217:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074043136 00000100:00100000:0.0:1783969366.811229:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074043136 00010000:00010000:0.0:1783969366.811272:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ab6 expref: 20 pid: 6521 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.811316:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:0.0:1783969366.811327:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+20:2391:x1870627074043136:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969366.811346:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969366.811353:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ab6 expref: 20 pid: 6521 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.811367:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ab6 expref: 20 pid: 6521 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.811427:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53200/0xea31253a47cba7d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ab6 expref: 20 pid: 6521 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.811457:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:0.0:1783969366.811463:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.811474:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.811481:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.811514:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969366.811567:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:2391:x1870627074043136:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 241us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.811575:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00010000:00010000:3.0:1783969366.812270:0:9027:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.812282:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969366.812433:0:9027:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1783969366.812558:0:9027:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:3.0:1783969366.812608:0:9027:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1783969366.813092:0:9027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98369aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9027:1870627099272704:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783969366.813151:0:9027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969366.813184:0:9027:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5ad7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969366.813277:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099272704 00000100:00100000:0.0:1783969366.813284:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099272704 00000100:00100000:0.0:1783969366.813319:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783969366.813326:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9027:x1870627099272704:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783969366.813428:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9027:x1870627099272704:12345-0@lo:1000:mdt00_004.0 Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.813435:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783969366.813517:0:9027:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1783969366.813524:0:9027:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93e983f8e300, transno 4294967316 00000100:00100000:3.0:1783969366.813548:0:9027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98369aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9027:1870627099272704:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1783969366.814558:0:9027:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1783969366.814637:0:9027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9027:1870627099272832:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783969366.814707:0:9027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969366.815292:0:9027:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9138a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969366.818576:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099272832 00000100:00100000:0.0:1783969366.818592:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099272832 00000100:00100000:0.0:1783969366.818671:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783969366.818682:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9027:x1870627099272832:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783969366.819042:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9027:x1870627099272832:12345-0@lo:1000:mdt00_004.0 Request processed in 361us (4334us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783969366.819067:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783969366.819663:0:9027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9027:1870627099272832:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783969366.819726:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819865:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819873:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819879:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de6c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.819884:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819892:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819908:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:3.0:1783969366.819919:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969366.819924:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819931:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cba817 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819956:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819962:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819969:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819973:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969366.819976:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819982:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.819991:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:3.0:1783969366.819993:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969366.819996:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.820002:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba74c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.820024:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.820049:0:9027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a9a expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.820058:0:9027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.820094:0:9027:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a9a expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.820108:0:9027:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a9a expref: 22 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.820122:0:9027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983eff480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099272960:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969366.820206:0:9027:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969366.832736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:2.0:1783969366.832807:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969366.833904:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074043264 00000100:00100000:0.0:1783969366.833917:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074043264 00010000:00010000:0.0:1783969366.833962:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a9a expref: 23 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.834000:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:0.0:1783969366.834010:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+23:2391:x1870627074043264:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969366.834027:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969366.834034:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a9a expref: 23 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.834048:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a9a expref: 23 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.834071:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:0.0:1783969366.834076:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.834086:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.834094:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.834114:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969366.834170:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+23:2391:x1870627074043264:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 160us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.834188:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00010000:00010000:3.0:1783969366.842246:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba768 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303a9a expref: 22 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969366.842271:0:9027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983eff480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099272960:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969366.842296:0:9027:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842406:0:9027:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842415:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842428:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842434:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842440:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842446:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969366.842450:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842457:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842475:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:0.0:1783969366.842479:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969366.842483:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842490:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cba81e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842501:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842519:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842525:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842530:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de7800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969366.842533:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842539:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842547:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93ea911e6100) 00010000:00010000:0.0:1783969366.842549:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783969366.842552:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969366.842556:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cba810 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969366.842756:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+21:12378:x1870627074042880:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 55798us (56828us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1783969366.842767:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 201 00000020:00080000:0.0:1783969366.842773:0:9027:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783969366.844051:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969366.844060:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969366.844562:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1783969366.844572:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969366.846684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969366.846793:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074043520 00000100:00100000:3.0:1783969366.846816:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074043520 00000100:00100000:3.0:1783969366.846872:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1783969366.846882:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+21:12378:x1870627074043520:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783969366.847145:0:6525:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783969366.847177:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1783969366.847211:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847229:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847242:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847250:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847257:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847263:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847280:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783969366.847366:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+23:12378:x1870627074043520:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 484us (692us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783969366.847375:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000020:00080000:3.0:1783969366.847403:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783969366.847456:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969366.847462:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847481:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969366.847485:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847493:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847505:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:3.0:1783969366.847509:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783969366.847514:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847520:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba825 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969366.847533:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969366.847534:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969366.847536:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783969367.256157:0:14677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969367.256167:0:14677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969367.256192:0:14677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1783969367.256198:0:14677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969367.475125:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.475221:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074043776 00000100:00100000:2.0:1783969367.475231:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074043776 00000100:00100000:2.0:1783969367.475300:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:2.0:1783969367.475310:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+23:12388:x1870627074043776:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969367.475336:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969367.475373:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba82c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303ad2 expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.475667:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daec00/0xea31253a47cba833 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.475686:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daec00/0xea31253a47cba833 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.475702:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daec00/0xea31253a47cba833 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969367.475713:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783969367.475823:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba82c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad2 expref: 26 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.475843:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daec00/0xea31253a47cba833 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad2 expref: 25 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.475851:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969367.475854:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969367.475858:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83daec00, rc 0) 00000100:00100000:2.0:1783969367.475922:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+25:12388:x1870627074043776:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 613us (806us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783969367.475930:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:0.0:1783969367.484486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.484574:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074043904 00000100:00100000:2.0:1783969367.484584:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074043904 00000100:00100000:2.0:1783969367.484655:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:2.0:1783969367.484679:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+25:12388:x1870627074043904:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1783969367.484812:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.484831:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.484846:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.484863:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.484870:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.484876:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.484965:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.484972:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.484979:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969367.485026:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485040:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485056:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485061:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485068:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.485072:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485079:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485091:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969367.485094:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969367.485098:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485104:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba841 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485119:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485124:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485129:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485133:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafc00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.485143:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485149:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485157:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170e00) 00010000:00010000:2.0:1783969367.485159:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969367.485162:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485167:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba848 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485184:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485190:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485196:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485200:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daee00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.485202:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485207:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485213:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170000) 00010000:00010000:2.0:1783969367.485215:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969367.485224:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.485229:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba84f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969367.485310:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+25:12388:x1870627074043904:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 644us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969367.485319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:0.0:1783969367.564914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.565093:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074044160 00000100:00100000:2.0:1783969367.565106:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074044160 00000100:00100000:2.0:1783969367.565173:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:2.0:1783969367.565184:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+25:12391:x1870627074044160:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969367.565205:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969367.565227:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba856 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303ad9 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565296:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565312:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565323:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565338:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565344:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565366:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565521:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565530:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565538:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969367.565548:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783969367.565629:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565648:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565654:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565660:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafc00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.565664:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565671:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565685:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969367.565688:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969367.565701:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565707:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba85d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565730:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565945:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565951:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565956:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.565959:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565964:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565972:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170000) 00010000:00010000:2.0:1783969367.565975:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969367.565978:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.565983:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba864 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.566028:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba856 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad9 expref: 28 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.566056:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad9 expref: 27 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.566064:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:2.0:1783969367.566067:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969367.566069:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae400, rc 0) 00000100:00100000:2.0:1783969367.566156:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12391:x1870627074044160:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 974us (1251us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1783969367.566164:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:3.0:1783969367.573524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.573647:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074044288 00000100:00100000:2.0:1783969367.573657:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074044288 00000100:00100000:2.0:1783969367.573732:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:2.0:1783969367.573743:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12391:x1870627074044288:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1783969367.573901:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.573920:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.573933:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.573969:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.573976:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.574001:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.574007:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daee00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.574012:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.574018:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.574030:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:2.0:1783969367.574033:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969367.574037:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.574044:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba879 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969367.574752:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12391:x1870627074044288:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 1009us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969367.574763:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:3.0:1783969367.588313:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969367.588419:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074044544 00000100:00100000:0.0:1783969367.588429:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074044544 00000100:00100000:0.0:1783969367.588506:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:0.0:1783969367.588517:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12391:x1870627074044544:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969367.590985:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+28:12391:x1870627074044544:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 2458us (2669us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1783969367.591002:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1783969367.652289:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.652409:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074044800 00000100:00100000:2.0:1783969367.652419:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074044800 00000100:00100000:2.0:1783969367.652482:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:2.0:1783969367.652492:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+28:11924:x1870627074044800:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1783969367.652516:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969367.652537:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba880 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303ae0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.652699:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.652731:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad9 expref: 29 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.652740:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.652774:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad9 expref: 29 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.652788:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad9 expref: 29 pid: 13769 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969367.652802:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099273088:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969367.652899:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5ad7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969367.661649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969367.662429:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074044928 00000100:00100000:0.0:1783969367.662440:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074044928 00010000:00010000:0.0:1783969367.662484:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad9 expref: 30 pid: 13769 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969367.662515:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:0.0:1783969367.662524:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+30:2391:x1870627074044928:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969367.662540:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969367.662547:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad9 expref: 30 pid: 13769 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.662559:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad9 expref: 30 pid: 13769 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.662582:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:0.0:1783969367.662587:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.662598:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.662606:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.662658:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969367.662728:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+30:2391:x1870627074044928:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 204us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969367.662737:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 94 00010000:00010000:2.0:1783969367.666969:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba86b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad9 expref: 29 pid: 13769 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969367.666993:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099273088:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969367.667022:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.667033:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.667061:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969367.667096:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783969367.667230:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba880 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae0 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.667246:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae0 expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.667255:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:2.0:1783969367.667259:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969367.667262:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83daf000, rc 0) 00000100:00100000:2.0:1783969367.667334:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+29:11924:x1870627074044800:12345-192.168.201.34@tcp:101:bash.0 Request processed in 14843us (15056us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1783969367.667343:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:1.0:1783969367.672946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.673241:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074045056 00000100:00100000:2.0:1783969367.673251:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074045056 00000100:00100000:2.0:1783969367.673306:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 207 00000100:00100000:2.0:1783969367.673317:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+29:11924:x1870627074045056:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1783969367.673341:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969367.673364:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba895 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303ae7 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.673428:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba89c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.673461:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba89c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.673474:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba89c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.673588:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daee00/0xea31253a47cba895 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae7 expref: 31 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.673605:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba89c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae7 expref: 30 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.673614:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:2.0:1783969367.673617:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969367.673621:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae400, rc 0) 00000100:00100000:2.0:1783969367.673707:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+30:11924:x1870627074045056:12345-192.168.201.34@tcp:101:bash.0 Request processed in 384us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969367.674181:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 207 00000100:00100000:3.0:1783969367.680777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.680876:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074045312 00000100:00100000:2.0:1783969367.680885:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074045312 00000100:00100000:2.0:1783969367.680942:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:2.0:1783969367.680951:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+30:11924:x1870627074045312:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1783969367.681176:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.681194:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.681223:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969367.681267:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:2.0:1783969367.681292:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b02e646 reply state 000000007313ca4c transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.681305:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.681312:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:2.0:1783969367.681315:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969367.681318:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783969367.681355:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:2.0:1783969367.681491:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+34:11924:x1870627074045312:12345-192.168.201.34@tcp:36:bash.0 Request processed in 540us (722us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1783969367.681499:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 208 00000020:00080000:2.0:1783969367.681504:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783969367.685354:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969367.685939:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074045440 00000100:00100000:0.0:1783969367.685953:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074045440 00000100:00100000:0.0:1783969367.686037:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:0.0:1783969367.686050:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+34:11924:x1870627074045440:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969367.686082:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969367.686111:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba8aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303aee expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.686188:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba8aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aee expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.686205:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba8aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aee expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.686225:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:0.0:1783969367.686228:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969367.686234:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796400, rc 0) 00000100:00100000:0.0:1783969367.686378:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+35:11924:x1870627074045440:12345-192.168.201.34@tcp:101:bash.0 Request processed in 331us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969367.686407:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:1.0:1783969367.696211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969367.696337:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074045568 00000100:00100000:0.0:1783969367.696349:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074045568 00000100:00100000:0.0:1783969367.696565:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:0.0:1783969367.696578:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:11924:x1870627074045568:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969367.696602:0:9974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969367.696639:0:9974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303af5 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969367.696675:0:9974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a553654, atime: 0x6a553653, ctime: 0x6a553654, blocks: 0x8 00010000:00010000:0.0:1783969367.696887:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=429s v=(0 0) 00010000:00010000:0.0:1783969367.696959:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969367.696971:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303af5 expref: 8 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.696995:0:9974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303af5 expref: 8 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.697011:0:9974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797e00, rc 0) 00000100:00100000:0.0:1783969367.697140:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:11924:x1870627074045568:12345-192.168.201.34@tcp:101:bash.0 Request processed in 564us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969367.697148:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1783969367.699758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969367.699863:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074045696 00000100:00100000:3.0:1783969367.699876:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074045696 00002000:00010000:3.0:1783969367.699938:0:8444:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1783969367.699944:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93e983fc6d80 with x1870627074045696 ext(0->18446744073709551615) 00002000:00010000:3.0:1783969367.699958:0:8444:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93e983fc6d80. 00000100:00100000:3.0:1783969367.699997:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1783969367.700027:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2393:x1870627074045696:12345-192.168.201.34@tcp:10:bash.0 00002000:00010000:3.0:1783969367.700346:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783969367.700350:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1783969364 -> 1783969366 00002000:00010000:3.0:1783969367.700352:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1783969363 -> 1783969363 00002000:00010000:3.0:1783969367.700355:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1783969364 -> 1783969366 00002000:00010000:3.0:1783969367.700357:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1783969367.700475:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2393:x1870627074045696:12345-192.168.201.34@tcp:10:bash.0 Request processed in 449us (729us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1783969367.700484:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00002000:00010000:3.0:1783969367.700489:0:8444:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1783969367.700491:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93e983fc6d80 with x1870627074045696 ext(0->18446744073709551615) 00002000:00010000:3.0:1783969367.700497:0:8444:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93e983fc6d80. 00000100:00100000:1.0:1783969367.791982:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.792675:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074045824 00000100:00100000:2.0:1783969367.792690:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074045824 00000100:00100000:2.0:1783969367.792790:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:2.0:1783969367.792802:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+35:12405:x1870627074045824:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1783969367.793117:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793140:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793155:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793198:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793205:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793212:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793310:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793321:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793328:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969367.793451:0:13769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793467:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793474:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793482:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793490:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.793496:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793512:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793530:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969367.793533:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969367.793539:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793546:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cba8b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793562:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793568:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793575:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793581:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.793584:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793591:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793598:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170000) 00010000:00010000:2.0:1783969367.793601:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969367.793603:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793620:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793650:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793657:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793663:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793668:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafa00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.793671:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793678:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.793686:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:2.0:1783969367.793688:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969367.793691:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.794305:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cba8c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969367.795119:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+35:12405:x1870627074045824:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 2308us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969367.795133:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:2.0:1783969367.828561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.828612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.828658:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.828701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969367.828874:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074045952 00000100:00100000:0.0:1783969367.828890:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074045952 00000100:00100000:0.0:1783969367.828963:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 403 00000100:00100000:0.0:1783969367.828977:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627074045952:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969367.829065:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2392:x1870627074045952:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 93us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969367.829073:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 403 00000100:00100000:1.0:1783969367.829496:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074046208 00000100:00100000:1.0:1783969367.829502:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074046208 00000100:00100000:1.0:1783969367.829563:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:1.0:1783969367.829570:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2392:x1870627074046208:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969367.829615:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2392:x1870627074046208:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 45us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969367.829623:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:2.0:1783969367.829915:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969367.830108:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074046464 00000100:00100000:3.0:1783969367.830114:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074046464 00000100:00100000:3.0:1783969367.830156:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074046080 00000100:00100000:3.0:1783969367.830160:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074046080 00000100:00100000:3.0:1783969367.830180:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074046336 00000100:00100000:3.0:1783969367.830183:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074046336 00000100:00100000:3.0:1783969367.830206:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 366 00000100:00100000:3.0:1783969367.830214:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074046464:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969367.830258:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074046464:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 45us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969367.830264:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 366 00000100:00100000:3.0:1783969367.830290:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 367 00000100:00100000:3.0:1783969367.830295:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074046080:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969367.830323:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2392:x1870627074046080:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969367.830329:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 367 00000100:00100000:3.0:1783969367.830339:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 368 00000100:00100000:3.0:1783969367.830344:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074046336:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969367.830369:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074046336:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969367.830375:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 368 00000100:00080000:0.0:1783969367.830892:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969367.830899:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969367.830902:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969367.838221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969367.838315:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074046720 00000100:00100000:3.0:1783969367.838328:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074046720 00000100:00100000:3.0:1783969367.838444:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:3.0:1783969367.838456:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+35:12408:x1870627074046720:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969367.838483:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969367.838511:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba8cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303afc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.838611:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.838641:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.838656:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.838895:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.838906:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.838914:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839060:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba8e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839071:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839078:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969367.839089:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783969367.839191:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839198:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839205:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839210:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969367.839215:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839232:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839246:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969367.839248:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969367.839254:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839260:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba8d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839276:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839281:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839286:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839291:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969367.839294:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839300:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839307:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93ea911e6f00) 00010000:00010000:3.0:1783969367.839310:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969367.839312:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839327:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba8db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839375:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba8cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303afc expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839452:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303afc expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.839460:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:3.0:1783969367.839462:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783969367.839465:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52a00, rc 0) 00000100:00100000:3.0:1783969367.839551:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+37:12408:x1870627074046720:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1096us (1344us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1783969367.839560:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:0.0:1783969367.843117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.843457:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074046848 00000100:00100000:2.0:1783969367.843473:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074046848 00000100:00100000:2.0:1783969367.843556:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:2.0:1783969367.843568:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+37:12408:x1870627074046848:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1783969367.844132:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.844156:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae0 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.844167:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.844216:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae0 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.844233:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae0 expref: 37 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969367.844252:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983f8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099273216:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969367.844376:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969367.847662:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969367.848020:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074047104 00000100:00100000:1.0:1783969367.848034:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074047104 00000100:00100000:1.0:1783969367.848156:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:1.0:1783969367.848170:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+38:6163:x1870627074047104:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783969367.848617:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+39:6163:x1870627074047104:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 449us (968us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1783969367.848640:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:3.0:1783969367.849309:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983f8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1870627099273216:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969367.849350:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969367.852127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969367.852232:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074047232 00000100:00100000:3.0:1783969367.852245:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074047232 00010000:00010000:3.0:1783969367.852299:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae0 expref: 39 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969367.852351:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:3.0:1783969367.852362:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2118c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+39:2391:x1870627074047232:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969367.852427:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969367.852435:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae0 expref: 39 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852449:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae0 expref: 39 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852478:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf000/0xea31253a47cba887 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae0 expref: 39 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852496:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:3.0:1783969367.852501:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852513:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852521:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852552:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969367.852613:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2118c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+38:2391:x1870627074047232:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 252us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969367.852622:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00010000:00010000:3.0:1783969367.852838:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852847:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852909:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852918:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852924:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852931:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969367.852936:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852945:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852954:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:3.0:1783969367.852957:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969367.852962:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969367.852969:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf600/0xea31253a47cba8f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969367.853012:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+37:12408:x1870627074046848:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 9447us (9911us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969367.853020:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:2.0:1783969367.856510:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969367.857016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074047488 00000100:00100000:0.0:1783969367.857029:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074047488 00000100:00100000:0.0:1783969367.857094:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:0.0:1783969367.857106:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+37:12408:x1870627074047488:12345-192.168.201.34@tcp:35:lfs.0 00010000:00010000:2.0:1783969367.857542:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783969367.858252:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783969367.859007:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+38:12408:x1870627074047488:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 1891us (2500us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1783969367.859022:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1783969367.949192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969367.949335:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074047744 00000100:00100000:0.0:1783969367.949350:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074047744 00000100:00100000:0.0:1783969367.949477:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:0.0:1783969367.949491:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+38:12419:x1870627074047744:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1783969367.949524:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969367.949551:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba8f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b03 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.949655:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.949674:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.949691:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.949724:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.949752:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.949759:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.949926:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba90c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.949936:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba90c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.949942:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba90c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969367.949954:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1783969367.950068:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950076:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950083:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950090:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969367.950095:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950104:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950130:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969367.950134:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969367.950140:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950147:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cba8fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950166:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950172:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950178:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950183:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdfa00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969367.950187:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950193:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950200:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93ea92d42000) 00010000:00010000:0.0:1783969367.950203:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969367.950206:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950212:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cba905 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950276:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cba8f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b03 expref: 41 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950292:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba90c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b03 expref: 40 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969367.950300:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:0.0:1783969367.950302:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969367.950304:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf800, rc 0) 00000100:00100000:0.0:1783969367.950454:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e8c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+40:12419:x1870627074047744:12345-192.168.201.34@tcp:101:cat.0 Request processed in 965us (1278us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1783969367.950462:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:2.0:1783969367.960878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969367.961068:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074048000 00000100:00100000:1.0:1783969367.961086:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074048000 00000100:00100000:1.0:1783969367.961173:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1783969367.961195:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+40:12419:x1870627074048000:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:1.0:1783969367.961648:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+41:12419:x1870627074048000:12345-192.168.201.34@tcp:35:cat.0 Request processed in 456us (785us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1783969367.961657:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:3.0:1783969367.990837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969367.991116:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074048256 00000100:00100000:2.0:1783969367.991130:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074048256 00000100:00100000:2.0:1783969367.991212:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 214 00000100:00100000:2.0:1783969367.991225:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+41:12420:x1870627074048256:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:2.0:1783969367.991300:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1783969367.991337:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cba8aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303aee expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991364:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba90c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b03 expref: 40 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991428:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cba8e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303afc expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991443:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cba89c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ae7 expref: 38 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991455:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:2.0:1783969367.991461:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969367.991492:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991603:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991616:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991645:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991670:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991678:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991949:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991959:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.991966:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969367.992245:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1783969367.992257:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 430119875512ns, next at 431119872422ns, rc = 0 00010000:00010000:2.0:1783969367.992312:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.992321:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.992329:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.992338:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.992345:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.992362:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.992963:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969367.992997:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993005:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993011:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993017:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.993022:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993029:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993042:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:2.0:1783969367.993045:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783969367.993050:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993055:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cba928 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993075:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993080:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993096:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993100:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daea00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969367.993103:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993109:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993116:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969367.993119:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969367.993121:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993126:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cba91a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969367.993135:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6fbbd65 reply state 00000000f7295bb9 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993148:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969367.993154:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170000) 00010000:00010000:2.0:1783969367.993156:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969367.993160:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969367.993281:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+39:12420:x1870627074048256:12345-192.168.201.34@tcp:36:rm.0 Request processed in 2054us (2465us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1783969367.993292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 214 00010000:00010000:1.0:1783969367.996155:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969367.996179:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969367.996195:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969367.996200:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969367.996213:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969367.996239:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:1.0:1783969367.996243:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783969367.996248:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969367.996255:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf800/0xea31253a47cba92f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969367.996277:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969367.996279:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969367.996281:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969368.049839:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969368.049977:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074048512 00000100:00100000:1.0:1783969368.049991:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074048512 00000100:00100000:1.0:1783969368.050144:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:1.0:1783969368.050156:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+39:12426:x1870627074048512:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1783969368.050206:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969368.050239:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba936 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b0a expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.050440:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.050460:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.050475:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.050488:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.050496:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.050503:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783969368.051052:0:7749:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1783969368.051225:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051237:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051246:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051309:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051317:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051324:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051331:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de7600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969368.051336:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051344:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051358:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969368.051361:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969368.051367:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051373:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cba93d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969368.051420:0:7749:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009951137d reply state 000000003933b263 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051434:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051440:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170000) 00010000:00010000:1.0:1783969368.051448:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783969368.051452:0:7749:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783969368.051489:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cba936 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b0a expref: 42 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051505:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b0a expref: 41 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.051512:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93e982253800) 00010000:00010000:1.0:1783969368.051514:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969368.051517:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7c00, rc 0) 00000100:00100000:1.0:1783969368.051634:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+42:12426:x1870627074048512:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1471us (1801us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1783969368.051647:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00080000:0.0:1783969368.055177:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969368.055372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.055476:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074048640 00000100:00100000:3.0:1783969368.055508:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074048640 00000100:00100000:3.0:1783969368.055584:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:3.0:1783969368.055596:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2392:x1870627074048640:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1783969368.055631:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969368.055659:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b11 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969368.055693:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783969368.055732:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1783969368.055738:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969368.055750:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b11 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.055771:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b11 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.055786:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52e00, rc 0) 00000100:00100000:3.0:1783969368.055863:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2392:x1870627074048640:12345-192.168.201.34@tcp:101:bash.0 Request processed in 269us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969368.055871:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:3.0:1783969368.059464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.059999:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074048768 00000100:00100000:0.0:1783969368.060013:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074048768 00000100:00100000:0.0:1783969368.060127:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:0.0:1783969368.060139:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:12426:x1870627074048768:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969368.060162:0:9974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969368.060187:0:9974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b18 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.060230:0:9974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b11 expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.060239:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969368.060245:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969368.060270:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 9 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.060321:0:9974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b11 expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.060337:0:9974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b11 expref: 9 pid: 8439 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.060355:0:9974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9974:1870627099273344:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969368.060519:0:9974:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a300 going to sleep for 11 seconds 00000100:00100000:1.0:1783969368.064744:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.064980:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074048896 00000100:00100000:3.0:1783969368.064992:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074048896 00010000:00010000:3.0:1783969368.065045:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b11 expref: 10 pid: 8439 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969368.065099:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:3.0:1783969368.065130:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2391:x1870627074048896:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969368.065149:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969368.065180:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b11 expref: 10 pid: 8439 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.065195:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b11 expref: 10 pid: 8439 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.065228:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969368.065233:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969368.065244:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 10 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.065257:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 10 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.065308:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 10 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969368.065326:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1870627099273472:192.168.201.34@tcp:105: 00000100:00100000:3.0:1783969368.065478:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab73159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969368.067942:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1870627099273472:192.168.201.34@tcp:105: 00010000:00010000:3.0:1783969368.067979:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969368.068058:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2391:x1870627074048896:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 2929us (3327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969368.068092:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00010000:00010000:0.0:1783969368.069245:0:9974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fa1172/0xea31253a47cba959 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b11 expref: 9 pid: 8439 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.069272:0:9974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9974:1870627099273344:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969368.069301:0:9974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 8 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.069318:0:9974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde400, rc 0) 00000100:00100000:0.0:1783969368.069377:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:12426:x1870627074048768:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9240us (9929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.069419:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:2.0:1783969368.072663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969368.072823:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074049152 00000100:00100000:1.0:1783969368.072836:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074049152 00000100:00100000:1.0:1783969368.072912:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:1.0:1783969368.072925:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+42:12426:x1870627074049152:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1783969368.073323:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+43:12426:x1870627074049152:12345-192.168.201.34@tcp:35:bash.0 Request processed in 400us (673us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1783969368.073332:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1783969368.224583:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.225141:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074049280 00000100:00100000:0.0:1783969368.225157:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074049280 00000100:00100000:0.0:1783969368.225252:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:0.0:1783969368.225264:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+43:12442:x1870627074049280:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969368.225328:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969368.225360:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b1f expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.225503:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba96e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.225523:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba96e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.225537:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba96e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969368.225591:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783969368.225595:0:9027:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969368.225618:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba96e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.225660:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b1f expref: 45 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.225682:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba96e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b1f expref: 44 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.225702:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969368.225909:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969368.225915:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdee00, rc 0) 00000100:00100000:0.0:1783969368.225999:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+44:12442:x1870627074049280:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 738us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.226008:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:2.0:1783969368.234559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.234684:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074049536 00000100:00100000:0.0:1783969368.234697:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074049536 00000100:00100000:0.0:1783969368.234785:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:0.0:1783969368.234796:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+44:12442:x1870627074049536:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969368.234824:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969368.234864:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba975 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b26 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.235021:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba97c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.235039:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba97c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.235053:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba97c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969368.235066:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783969368.235213:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba975 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b26 expref: 47 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.235236:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba97c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b26 expref: 46 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.235246:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93e982253800) 00010000:00010000:0.0:1783969368.235249:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969368.235252:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf200, rc 0) 00000100:00100000:0.0:1783969368.235336:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+46:12442:x1870627074049536:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 540us (792us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1783969368.235366:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:1.0:1783969368.239734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.239894:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074049792 00000100:00100000:3.0:1783969368.239908:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074049792 00000100:00100000:3.0:1783969368.239992:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:3.0:1783969368.240006:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+46:12442:x1870627074049792:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969368.240039:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969368.240068:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba98a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b2d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.240223:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba991 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.240245:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba991 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.240259:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba991 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969368.240274:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783969368.240434:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba98a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b2d expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.240457:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba991 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b2d expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.240466:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93e982253800) 00010000:00010000:3.0:1783969368.240470:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969368.240493:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53400, rc 0) 00000100:00100000:3.0:1783969368.240580:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+48:12442:x1870627074049792:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 577us (868us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1783969368.240588:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:0.0:1783969368.243125:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.243679:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074049920 00000100:00100000:3.0:1783969368.243701:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074049920 00000100:00100000:3.0:1783969368.243864:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1783969368.243878:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+48:2392:x1870627074049920:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969368.243899:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969368.243933:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba97c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b26 expref: 48 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.243958:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93e982253800) 00010000:00010000:3.0:1783969368.243964:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969368.244038:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+47:2392:x1870627074049920:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 162us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969368.244046:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1783969368.252074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969368.253269:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074050048 00000100:00100000:2.0:1783969368.253288:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074050048 00000100:00100000:2.0:1783969368.253422:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:2.0:1783969368.253436:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2393:x1870627074050048:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:2.0:1783969368.253503:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.253530:0:14243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 8 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.253540:0:14243:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969368.253544:0:14243:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969368.253550:0:14243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.253597:0:14243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 8 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.253613:0:14243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 8 pid: 9974 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969368.253643:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983f8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14243:1870627099273600:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969368.253780:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969368.257416:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983f8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14243:1870627099273600:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969368.257485:0:14243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.259775:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969368.268598:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074050176 00000100:00100000:2.0:1783969368.268631:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074050176 00002000:00100000:2.0:1783969368.268897:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff93eab73e1c00 x1870627074050176/t0(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:264/0 lens 504/0 e 0 to 0 dl 1783969379 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969368.268910:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab73e1c00 with x1870627074050176 ext(0->8) 00010000:00010000:2.0:1783969368.268922:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 9 pid: 9974 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.268941:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 9 pid: 9974 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969368.268950:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93eab73e1c00 00000100:00100000:2.0:1783969368.269038:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1783969368.269051:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2392:x1870627074050176:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:2.0:1783969368.271809:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+11:2392:x1870627074050176:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 2744us (12030us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783969368.271830:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00002000:00100000:2.0:1783969368.271859:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff93eab73e1c00 x1870627074050176/t4294967309(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:264/0 lens 504/448 e 0 to 0 dl 1783969379 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969368.271871:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab73e1c00 with x1870627074050176 ext(0->8) 00010000:00010000:2.0:1783969368.271886:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 11 pid: 9974 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.271937:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 11 pid: 9974 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969368.271947:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93eab73e1c00 00000100:00100000:1.0:1783969368.278781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.278907:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074050304 00000100:00100000:0.0:1783969368.278921:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074050304 00010000:00010000:0.0:1783969368.278978:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 11 pid: 9974 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.279039:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:0.0:1783969368.279051:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+11:2391:x1870627074050304:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969368.279072:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783969368.279097:0:7929:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783969368.279101:0:7929:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783969367 00002000:00010000:0.0:1783969368.279103:0:7929:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783969367 00002000:00010000:0.0:1783969368.279106:0:7929:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1783969367 00002000:00010000:0.0:1783969368.279108:0:7929:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783969368.279116:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 11 pid: 9974 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.279134:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 11 pid: 9974 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.279167:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e464fa53/0xea31253a47cba960 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b18 expref: 11 pid: 9974 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.279213:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969368.279218:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969368.279225:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.279237:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.279278:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969368.279350:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2391:x1870627074050304:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 300us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.279358:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00010000:00010000:2.0:1783969368.279700:0:14243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.279712:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.279738:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.279747:0:14243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.279755:0:14243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.279762:0:14243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969368.279768:0:14243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.279778:0:14243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.279808:0:14243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.279817:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cba99f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969368.279880:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2393:x1870627074050048:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 26447us (27822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969368.279890:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:1.0:1783969368.282747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.282950:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074050560 00000100:00100000:3.0:1783969368.282966:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074050560 00000100:00100000:3.0:1783969368.283043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1783969368.283056:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+47:12442:x1870627074050560:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:3.0:1783969368.283145:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba991 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b2d expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969368.283456:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1783969368.284056:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1783969368.285111:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1783969368.285203:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.285226:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b0a expref: 51 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.285235:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.285290:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b0a expref: 51 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.285311:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b0a expref: 51 pid: 7749 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969368.285331:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1870627099273728:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969368.287138:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7315900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969368.290940:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1870627099273728:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969368.290983:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969368.292924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969368.293128:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074050688 00000100:00100000:2.0:1783969368.293140:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074050688 00010000:00010000:2.0:1783969368.293194:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b0a expref: 52 pid: 7749 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969368.293245:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:2.0:1783969368.293257:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+52:2391:x1870627074050688:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969368.293276:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969368.293284:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b0a expref: 52 pid: 7749 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.293299:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b0a expref: 52 pid: 7749 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.293326:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cba94b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b0a expref: 52 pid: 7749 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.293358:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93e982253800) 00010000:00010000:2.0:1783969368.293365:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.293377:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.293439:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.293477:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969368.293555:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+51:2391:x1870627074050688:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 299us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969368.293564:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 98 00010000:00010000:1.0:1783969368.294744:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.294762:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969368.294936:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1783969368.295084:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1783969368.295200:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099273856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783969368.295277:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969368.295324:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419600 going to sleep for 11 seconds 00000100:00100000:0.0:1783969368.295550:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099273856 00000100:00100000:0.0:1783969368.295559:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099273856 00000100:00100000:0.0:1783969368.295636:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783969368.295647:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1870627099273856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783969368.295754:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1870627099273856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.295762:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:3.0:1783969368.296109:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969368.297532:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099273856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783969368.297755:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1783969368.297852:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099273984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783969368.297928:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969368.297964:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e9834199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969368.298251:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099273984 00000100:00100000:0.0:1783969368.298277:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099273984 00000100:00100000:0.0:1783969368.298347:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783969368.298358:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8e9ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1870627099273984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783969368.298584:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8e9ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6524:x1870627099273984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 228us (655us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783969368.298593:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1783969368.299552:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1870627099273984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783969368.299653:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1783969368.299714:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.299728:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.299737:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.299744:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969368.299748:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.299766:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.299786:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93e982253800) 00010000:00010000:3.0:1783969368.299789:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783969368.299794:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.299800:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969368.300075:0:6524:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783969368.300160:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1783969368.300174:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 430427792070ns, next at 431427789505ns, rc = 0 00000001:00080000:3.0:1783969368.300180:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:3.0:1783969368.300208:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93e982253800) 00010000:00010000:3.0:1783969368.300212:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969368.300220:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba991 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b2d expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969368.300371:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+54:12442:x1870627074050560:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 17317us (17638us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1783969368.300426:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000020:00080000:3.0:1783969368.300431:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783969368.303947:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.304431:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074050816 00000100:00100000:0.0:1783969368.304446:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074050816 00000100:00100000:0.0:1783969368.304521:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:0.0:1783969368.304534:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+54:12442:x1870627074050816:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969368.304567:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969368.304599:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba9ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b34 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.304690:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba9ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b34 expref: 55 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.304710:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba9ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b34 expref: 55 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.304733:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969368.304736:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969368.304741:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf800, rc 0) 00000100:00100000:0.0:1783969368.304817:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+55:12442:x1870627074050816:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 285us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.304826:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:3.0:1783969368.309056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969368.309154:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074051072 00000100:00100000:1.0:1783969368.309167:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074051072 00000100:00100000:1.0:1783969368.309236:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1783969368.309248:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+55:12442:x1870627074051072:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1783969368.309606:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+56:12442:x1870627074051072:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 359us (564us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1783969368.309614:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1783969368.413074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.413193:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074051200 00000100:00100000:0.0:1783969368.413226:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074051200 00000100:00100000:0.0:1783969368.413307:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:0.0:1783969368.413330:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+56:12452:x1870627074051200:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1783969368.413474:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413499:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413513:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413525:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413533:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413540:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413667:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413676:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413683:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969368.413745:0:13769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413785:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413791:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413798:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413805:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969368.413811:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413819:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413834:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969368.413846:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969368.413852:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413858:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cba9b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413874:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413879:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413886:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413897:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969368.413900:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413905:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413913:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170000) 00010000:00010000:0.0:1783969368.413916:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969368.413918:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413923:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413936:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413942:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413947:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413952:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969368.413955:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413961:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413978:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969368.413980:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969368.413983:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.413989:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.414089:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+56:12452:x1870627074051200:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 761us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.414099:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:2.0:1783969368.522536:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.523553:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074051456 00000100:00100000:3.0:1783969368.523582:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074051456 00000100:00100000:3.0:1783969368.523685:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:3.0:1783969368.523697:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+56:12455:x1870627074051456:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969368.523757:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969368.523787:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba9c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b3b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.523885:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.523904:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.523918:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.523930:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.523937:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.523943:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524098:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524106:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524114:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969368.524125:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783969368.524236:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524245:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524252:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524259:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969368.524263:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524271:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524285:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:3.0:1783969368.524288:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969368.524294:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524300:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cba9d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524316:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524322:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524328:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524333:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969368.524341:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524347:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524355:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170000) 00010000:00010000:3.0:1783969368.524358:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969368.524361:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524367:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cba9d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524479:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cba9c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b3b expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524494:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b3b expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.524502:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:3.0:1783969368.524505:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969368.524508:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52e00, rc 0) 00000100:00100000:3.0:1783969368.524604:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+58:12455:x1870627074051456:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 909us (2084us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1783969368.524614:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:1.0:1783969368.542452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.542659:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074051584 00000100:00100000:0.0:1783969368.542674:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074051584 00000100:00100000:0.0:1783969368.543671:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 222 00000100:00100000:0.0:1783969368.543707:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+58:12455:x1870627074051584:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1783969368.543979:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.544002:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.544018:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.544067:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.544075:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.544103:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.544108:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969368.544114:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.544122:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.544137:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969368.544141:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969368.544146:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.544153:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.544262:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+58:12455:x1870627074051584:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 576us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.544270:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 222 00000100:00100000:2.0:1783969368.552528:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969368.552678:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074051840 00000100:00100000:1.0:1783969368.552719:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074051840 00000100:00100000:1.0:1783969368.552801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:1.0:1783969368.552814:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+58:12455:x1870627074051840:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1783969368.553134:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+59:12455:x1870627074051840:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 322us (622us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1783969368.553143:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:2.0:1783969368.660215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.660336:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074052096 00000100:00100000:0.0:1783969368.660351:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074052096 00000100:00100000:0.0:1783969368.660583:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:0.0:1783969368.660597:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+59:12465:x1870627074052096:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969368.660642:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969368.660646:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783969368.660941:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cba96e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b1f expref: 59 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.660994:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969368.661000:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969368.661018:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b42 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.661157:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.661175:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b3b expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.661185:0:13769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.661223:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b3b expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.661236:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b3b expref: 59 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.661250:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099274112:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969368.661368:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969368.663655:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.663908:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099274112:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969368.663942:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969368.664022:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074052224 00000100:00100000:1.0:1783969368.664031:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074052224 00010000:00010000:1.0:1783969368.664079:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b3b expref: 60 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969368.664125:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:1.0:1783969368.664136:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+60:2392:x1870627074052224:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969368.664153:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969368.664161:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b3b expref: 60 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.664174:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b3b expref: 60 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.664200:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cba9de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b3b expref: 60 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.664216:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:1.0:1783969368.664222:0:7929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.664253:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.664262:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.665251:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969368.665658:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.665673:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969368.665812:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783969368.666010:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cba9f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b42 expref: 61 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.666175:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b42 expref: 60 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.666194:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:2.0:1783969368.666197:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969368.666199:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf200, rc 0) 00000100:00100000:1.0:1783969368.666282:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+60:2392:x1870627074052224:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 2146us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969368.666291:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:2.0:1783969368.667175:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+59:12465:x1870627074052096:12345-192.168.201.34@tcp:101:bash.0 Request processed in 6575us (6971us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1783969368.667187:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:3.0:1783969368.669257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.669348:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074052352 00000100:00100000:0.0:1783969368.669375:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074052352 00000100:00100000:0.0:1783969368.669458:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:0.0:1783969368.669467:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+59:12465:x1870627074052352:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969368.669495:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969368.669521:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cbaa08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b49 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.669558:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.669583:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.669600:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.669871:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cbaa08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b49 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.669888:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b49 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.669895:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969368.669898:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783969368.669901:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdfa00, rc 0) 00000100:00100000:0.0:1783969368.670037:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+60:12465:x1870627074052352:12345-192.168.201.34@tcp:101:bash.0 Request processed in 571us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.670043:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:3.0:1783969368.672209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.672285:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074052608 00000100:00100000:0.0:1783969368.672318:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074052608 00000100:00100000:0.0:1783969368.672373:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:0.0:1783969368.672419:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+60:12465:x1870627074052608:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:0.0:1783969368.672717:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.672734:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.672797:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969368.672842:0:9027:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1783969368.672862:0:9027:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000028e915df reply state 000000001d54d3b8 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.672872:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.672878:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969368.672881:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783969368.672883:0:9027:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969368.672967:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12465:x1870627074052608:12345-192.168.201.34@tcp:36:bash.0 Request processed in 587us (768us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1783969368.672974:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 225 00000020:00080000:0.0:1783969368.672978:0:9027:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783969368.675287:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.675497:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074052736 00000100:00100000:3.0:1783969368.675526:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074052736 00000100:00100000:3.0:1783969368.675597:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 226 00000100:00100000:3.0:1783969368.675608:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12465:x1870627074052736:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1783969368.675651:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969368.675678:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cbaa1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b50 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.675963:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.675979:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b42 expref: 64 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.675989:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.676037:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b42 expref: 64 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.676053:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b42 expref: 64 pid: 13769 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969368.676072:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983eff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1870627099274240:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969368.676216:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7315d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969368.680572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.680710:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983eff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1870627099274240:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969368.680886:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969368.680959:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074052864 00000100:00100000:2.0:1783969368.680966:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074052864 00010000:00010000:2.0:1783969368.681009:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b42 expref: 65 pid: 13769 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969368.681045:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:2.0:1783969368.681052:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+65:2392:x1870627074052864:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969368.681067:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969368.681073:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b42 expref: 65 pid: 13769 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.681083:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b42 expref: 65 pid: 13769 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.681106:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cba9fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b42 expref: 65 pid: 13769 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.681124:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:2.0:1783969368.681144:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.681153:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.681160:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.681191:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969368.681248:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+64:2392:x1870627074052864:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 196us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969368.681253:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00010000:00010000:0.0:1783969368.681305:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.681320:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969368.681419:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783969368.681423:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969368.681445:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.681475:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52200/0xea31253a47cbaa1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b50 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.681487:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b50 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.681493:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969368.681495:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969368.681496:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53400, rc 0) 00000100:00100000:0.0:1783969368.681518:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12465:x1870627074052736:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5914us (6245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.681522:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 226 00000100:00100000:2.0:1783969368.688734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.688997:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074053120 00000100:00100000:3.0:1783969368.689026:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074053120 00000100:00100000:3.0:1783969368.689085:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1783969368.689095:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+63:12465:x1870627074053120:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1783969368.689441:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12465:x1870627074053120:12345-192.168.201.34@tcp:35:bash.0 Request processed in 346us (721us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1783969368.689450:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:1.0:1783969368.775973:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.776241:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074053248 00000100:00100000:0.0:1783969368.776255:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074053248 00000100:00100000:0.0:1783969368.776497:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 227 00000100:00100000:0.0:1783969368.776512:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+64:12471:x1870627074053248:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969368.776545:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969368.776576:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cbaa2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b57 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.776689:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaa32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.776734:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaa32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.776864:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaa32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969368.776926:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783969368.776931:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969368.776955:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaa32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.776983:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cbaa2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b57 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.777006:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaa32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b57 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.777016:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969368.777019:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969368.777023:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf200, rc 0) 00000100:00100000:0.0:1783969368.777099:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12471:x1870627074053248:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 590us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.777107:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 227 00000100:00100000:2.0:1783969368.781950:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.782040:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074053376 00000100:00100000:0.0:1783969368.782054:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074053376 00000100:00100000:0.0:1783969368.782134:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:0.0:1783969368.782147:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12471:x1870627074053376:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969368.782176:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969368.782226:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbaa39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b5e expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782333:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782353:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782368:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782421:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782432:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782439:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782548:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782559:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782566:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969368.782635:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783969368.782641:0:9027:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969368.782667:0:9027:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782691:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782710:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782718:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782725:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.782731:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969368.782736:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783034:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783052:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969368.783056:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969368.783061:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783068:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783086:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783093:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783108:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783114:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969368.783117:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783124:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783134:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170000) 00010000:00010000:0.0:1783969368.783137:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969368.783140:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783146:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783180:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbaa39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b5e expref: 67 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783199:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b5e expref: 66 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.783207:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969368.783209:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969368.783212:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797a00, rc 0) 00000100:00100000:0.0:1783969368.783300:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+66:12471:x1870627074053376:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1155us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.783943:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:2.0:1783969368.791084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969368.791147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.791249:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074053760 00000100:00100000:3.0:1783969368.791262:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074053760 00000100:00100000:3.0:1783969368.791358:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1783969368.791370:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab211a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+66:2392:x1870627074053760:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969368.791438:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969368.791473:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b5e expref: 66 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.791497:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:3.0:1783969368.791503:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969368.791566:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab211a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+65:2392:x1870627074053760:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 197us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969368.791575:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1783969368.793247:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074053632 00000100:00100000:0.0:1783969368.793265:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074053632 00000100:00100000:0.0:1783969368.793351:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:0.0:1783969368.793362:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12471:x1870627074053632:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969368.793428:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969368.793457:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b65 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.793602:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.793631:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b50 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.793641:0:13769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.794076:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b50 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.794092:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b50 expref: 66 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.794109:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099274368:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969368.794242:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a000 going to sleep for 11 seconds 00000100:00100000:0.0:1783969368.800487:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099274368:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969368.800546:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969368.801707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969368.801970:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074053888 00000100:00100000:0.0:1783969368.801980:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074053888 00010000:00010000:0.0:1783969368.802032:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b50 expref: 67 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.802077:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:0.0:1783969368.802088:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+67:2391:x1870627074053888:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969368.802107:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969368.802116:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b50 expref: 67 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.802129:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b50 expref: 67 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.802168:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53400/0xea31253a47cbaa24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b50 expref: 67 pid: 6523 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.802188:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969368.802194:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.802206:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.802216:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.802266:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969368.802353:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+66:2391:x1870627074053888:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 265us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.802362:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00010000:00010000:2.0:1783969368.802637:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.802646:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969368.802678:0:13769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783969368.802864:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaa55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b65 expref: 67 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.802883:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b65 expref: 66 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.802904:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:2.0:1783969368.802907:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969368.802910:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796400, rc 0) 00000100:00100000:2.0:1783969368.802944:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+66:12471:x1870627074053632:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 9584us (11879us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1783969368.802951:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:1.0:1783969368.810085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.810193:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074054144 00000100:00100000:3.0:1783969368.810206:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074054144 00000100:00100000:3.0:1783969368.810336:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1783969368.810349:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+66:12471:x1870627074054144:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:3.0:1783969368.810370:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969368.810582:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cba9ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b34 expref: 66 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.810640:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:3.0:1783969368.810646:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969368.810895:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12471:x1870627074054144:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 547us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969368.810904:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1783969368.814165:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.814258:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074054272 00000100:00100000:3.0:1783969368.814271:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074054272 00000100:00100000:3.0:1783969368.814352:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00100000:3.0:1783969368.814365:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12471:x1870627074054272:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:0.0:1783969368.815174:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.815202:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.815217:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969368.815363:0:7749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1783969368.816232:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12471:x1870627074054272:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 1862us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969368.816245:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00100000:2.0:1783969368.825136:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969368.825295:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074054400 00000100:00100000:1.0:1783969368.825414:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074054400 00000100:00100000:1.0:1783969368.825487:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00100000:1.0:1783969368.825499:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+65:12471:x1870627074054400:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969368.825527:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969368.825555:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b6c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.825882:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.825898:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b6c expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.825944:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.825960:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b6c expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.825976:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:1.0:1783969368.825979:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969368.825984:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b6c expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.825992:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7400, rc 0) 00000100:00100000:1.0:1783969368.826073:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+66:12471:x1870627074054400:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 575us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969368.826082:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 231 00010000:00010000:3.0:1783969368.881490:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783969368.881832:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969368.881840:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969368.881876:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1783969368.881888:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783969368.882076:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099274496:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783969368.884841:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969368.905924:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099274496:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783969368.912013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.912133:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074054528 00000100:00100000:3.0:1783969368.912147:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074054528 00000100:00100000:3.0:1783969368.912230:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:3.0:1783969368.912242:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+66:12472:x1870627074054528:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783969368.912288:0:6523:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783969368.912458:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+66:12472:x1870627074054528:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 217us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969368.912467:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:0.0:1783969368.922938:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969368.930809:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074054656 00000100:00100000:3.0:1783969368.930831:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074054656 00000100:00100000:3.0:1783969368.930944:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00100000:3.0:1783969368.930957:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+66:12472:x1870627074054656:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783969368.931053:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931092:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931107:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931129:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931136:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931143:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931171:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931181:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931187:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969368.931249:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783969368.931254:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969368.931271:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931282:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.931301:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932521:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932530:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969368.932535:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932545:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932564:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:3.0:1783969368.932567:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969368.932574:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932581:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbaa78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932678:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932687:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932693:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932699:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969368.932718:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932724:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932732:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff93ea911e6f00) 00010000:00010000:3.0:1783969368.932735:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969368.932738:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932744:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaa7f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932767:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932773:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932779:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932784:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969368.932787:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932794:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932802:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:3.0:1783969368.932804:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969368.932814:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969368.932819:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaa86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969368.933150:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+66:12472:x1870627074054656:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 2187us (10218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969368.933163:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00100000:0.0:1783969368.941559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969368.941714:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074054912 00000100:00100000:2.0:1783969368.941727:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074054912 00000100:00100000:2.0:1783969368.941805:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:2.0:1783969368.941817:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+66:12472:x1870627074054912:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969368.941844:0:9027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969368.941870:0:9027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cbaa8d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b73 expref: -99 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942015:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942035:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942050:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969368.942084:0:9027:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783969368.942185:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942193:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942201:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942208:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969368.942213:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942221:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942235:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:2.0:1783969368.942239:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783969368.942243:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942251:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbaa94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.942297:0:9027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cbaa8d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b73 expref: 68 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.946159:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:2.0:1783969368.946166:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969368.946205:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafa00/0xea31253a47cbaa8d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b73 expref: 68 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969368.946230:0:9027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dafa00, rc 0) 00000100:00100000:2.0:1783969368.946333:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+67:12472:x1870627074054912:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 4516us (4786us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1783969368.946344:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:3.0:1783969368.952433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969368.952603:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074055040 00000100:00100000:1.0:1783969368.952622:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074055040 00000100:00100000:1.0:1783969368.952702:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:1.0:1783969368.952714:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+67:12472:x1870627074055040:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783969368.952764:0:6523:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783969368.952931:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+67:12472:x1870627074055040:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 219us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969368.952940:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:0.0:1783969368.971157:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969368.977001:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074055296 00000100:00100000:1.0:1783969368.977021:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074055296 00000100:00100000:1.0:1783969368.977184:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00100000:1.0:1783969368.977199:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+67:12472:x1870627074055296:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969368.977226:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969368.977230:0:7749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783969368.977266:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaa32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b57 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.977294:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:1.0:1783969368.977300:0:7749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969368.977328:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbaaa2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b7a expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783969368.978864:0:7749:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1783969368.979064:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cbaaa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.979084:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cbaaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.979098:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cbaaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.979171:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbaaa2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b7a expref: 69 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.979220:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cbaaa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b7a expref: 68 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969368.979229:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253a00) 00010000:00010000:1.0:1783969368.979232:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969368.979235:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6c00, rc 0) 00000100:00100000:1.0:1783969368.979344:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+68:12472:x1870627074055296:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2147us (8202us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1783969368.979355:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00100000:3.0:1783969368.987270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969368.987499:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074055552 00000100:00100000:1.0:1783969368.987518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074055552 00000100:00100000:0.0:1783969368.995784:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:0.0:1783969368.995805:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+68:12472:x1870627074055552:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783969368.995885:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969368.995921:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6c00/0xea31253a47cbaaa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b7a expref: 68 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.995944:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253a00) 00010000:00010000:0.0:1783969368.995972:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969368.996000:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996016:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996027:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996041:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996047:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996052:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996110:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996117:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996124:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996131:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969368.996136:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996145:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996159:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969368.996161:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969368.996165:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996171:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796000/0xea31253a47cbaab7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996179:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996183:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996188:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996193:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969368.996195:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996200:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996204:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x335c869c (ffff93ea92d42300) 00010000:00010000:0.0:1783969368.996206:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969368.996208:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969368.996212:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaabe lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x335c869c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969368.997053:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+67:12472:x1870627074055552:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1247us (9786us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783969368.997063:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:3.0:1783969369.005071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969369.006434:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074055680 00000100:00100000:1.0:1783969369.006454:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074055680 00000100:00100000:1.0:1783969369.006544:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:1.0:1783969369.006556:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+67:12472:x1870627074055680:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969369.006582:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969369.006619:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cbaac5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b81 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.006665:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.006681:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.006694:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.006846:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7800/0xea31253a47cbaac5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b81 expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.006868:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b81 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.006877:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:1.0:1783969369.006881:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783969369.006885:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7000, rc 0) 00000100:00100000:1.0:1783969369.006976:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+68:12472:x1870627074055680:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 422us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969369.006983:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:1.0:1783969369.018856:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.019234:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074055936 00000100:00100000:0.0:1783969369.019248:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074055936 00000100:00100000:0.0:1783969369.019333:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 239 00000100:00100000:0.0:1783969369.019345:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+68:12472:x1870627074055936:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783969369.019493:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.019516:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.019530:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969369.019745:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1783969369.019756:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431147374454ns, next at 432147371240ns, rc = 0 00000004:00010000:0.0:1783969369.019820:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c75065f5 reply state 00000000c36d8560 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.019836:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.019844:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:0.0:1783969369.019848:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783969369.019852:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969369.019975:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+70:12472:x1870627074055936:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 631us (1134us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1783969369.020004:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 239 00000100:00100000:3.0:1783969369.023180:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.023331:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074056064 00000100:00100000:0.0:1783969369.023344:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074056064 00000100:00100000:0.0:1783969369.023498:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:0.0:1783969369.023511:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+70:12472:x1870627074056064:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969369.023543:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969369.023569:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b88 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.023658:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b88 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.023675:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b88 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.023697:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:0.0:1783969369.023701:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969369.023705:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf800, rc 0) 00000100:00100000:0.0:1783969369.023781:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+71:12472:x1870627074056064:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 273us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969369.023789:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:2.0:1783969369.029991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.030102:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074056192 00000100:00100000:0.0:1783969369.030114:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074056192 00000100:00100000:0.0:1783969369.030202:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:0.0:1783969369.030215:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2392:x1870627074056192:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783969369.030689:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2392:x1870627074056192:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 473us (708us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1783969369.031061:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00080000:3.0:1783969369.031272:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969369.044224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969369.044340:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074056448 00000100:00100000:3.0:1783969369.044353:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074056448 00000100:00100000:3.0:1783969369.044468:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1783969369.044480:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+71:12472:x1870627074056448:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783969369.044782:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+72:12472:x1870627074056448:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 303us (572us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1783969369.044792:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:0.0:1783969369.055320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969369.055496:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074056704 00000100:00100000:1.0:1783969369.055510:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074056704 00000100:00100000:1.0:1783969369.055593:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 241 00000100:00100000:1.0:1783969369.055615:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+72:12472:x1870627074056704:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783969369.055780:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+72:12472:x1870627074056704:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 175us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969369.055789:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 241 00000100:00100000:2.0:1783969369.067630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969369.069409:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074056832 00000100:00100000:3.0:1783969369.069429:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074056832 00000100:00100000:3.0:1783969369.069523:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 242 00000100:00100000:3.0:1783969369.069538:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+72:12472:x1870627074056832:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969369.069581:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969369.069620:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaae1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b8f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.069732:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaae8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.069774:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.069789:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969369.069851:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969369.069875:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.069906:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbaae1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b8f expref: 74 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.069929:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaae8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b8f expref: 73 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.069939:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:3.0:1783969369.069942:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783969369.069947:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52a00, rc 0) 00000100:00100000:3.0:1783969369.070042:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+73:12472:x1870627074056832:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 507us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969369.070050:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 242 00000100:00100000:1.0:1783969369.081285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969369.082471:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074056960 00000100:00100000:2.0:1783969369.082487:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074056960 00000100:00100000:2.0:1783969369.082572:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:2.0:1783969369.082585:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+10:2392:x1870627074056960:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969369.082621:0:9974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969369.082650:0:9974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b96 expref: -99 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969369.082956:0:9974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a553658, blocks: 0x0 00010000:00010000:2.0:1783969369.082986:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1783969369.082992:0:9974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969369.083006:0:9974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b96 expref: 11 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.083028:0:9974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b96 expref: 11 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.083044:0:9974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83daf000, rc 0) 00000100:00100000:2.0:1783969369.083154:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+11:2392:x1870627074056960:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 571us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969369.083168:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:3.0:1783969369.086377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.086685:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074057216 00000100:00100000:0.0:1783969369.086705:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074057216 00000100:00100000:0.0:1783969369.086964:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 243 00000100:00100000:0.0:1783969369.086977:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+73:12472:x1870627074057216:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783969369.087132:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+73:12472:x1870627074057216:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 157us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969369.087141:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 243 00000100:00100000:3.0:1783969369.090052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969369.090198:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074057344 00000100:00100000:2.0:1783969369.090212:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074057344 00000100:00100000:2.0:1783969369.090355:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:2.0:1783969369.090368:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+11:12472:x1870627074057344:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969369.090429:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969369.090458:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303b9d expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.090501:0:14243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b96 expref: 12 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.090512:0:14243:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969369.090518:0:14243:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969369.090524:0:14243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 12 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.090571:0:14243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b96 expref: 12 pid: 9974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.090588:0:14243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b96 expref: 12 pid: 9974 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969369.090604:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14243:1870627099274624:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969369.090784:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969369.100202:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983f8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14243:1870627099274624:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969369.100261:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 12 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.100291:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83daf600, rc 0) 00000100:00100000:2.0:1783969369.100446:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+12:12472:x1870627074057344:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 10080us (10407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969369.100457:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:3.0:1783969369.101541:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.101709:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074057472 00000100:00100000:0.0:1783969369.101720:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074057472 00010000:00010000:0.0:1783969369.101773:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b96 expref: 12 pid: 9974 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.101825:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:0.0:1783969369.101837:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+12:2391:x1870627074057472:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969369.101858:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969369.101889:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b96 expref: 12 pid: 9974 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.101905:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b96 expref: 12 pid: 9974 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.101936:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc2e0dab/0xea31253a47cbaaef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b96 expref: 12 pid: 9974 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.101981:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969369.101987:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969369.101997:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 11 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.102010:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 11 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.102057:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 11 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.102075:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1870627099274752:192.168.201.34@tcp:105: 00000100:00100000:0.0:1783969369.102184:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969369.108276:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1870627099274752:192.168.201.34@tcp:105: 00010000:00010000:1.0:1783969369.108317:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969369.108406:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+11:2391:x1870627074057472:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 6545us (6846us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969369.108434:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:0.0:1783969369.113116:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969369.115920:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074057600 00000100:00100000:1.0:1783969369.115942:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074057600 00002000:00100000:1.0:1783969369.116024:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff93eab73e1180 x1870627074057600/t0(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:265/0 lens 504/0 e 0 to 0 dl 1783969380 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783969369.116039:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab73e1180 with x1870627074057600 ext(0->12) 00002000:00010000:1.0:1783969369.116047:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93eab73e1180 00000100:00100000:1.0:1783969369.116094:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1783969369.116106:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+11:2392:x1870627074057600:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783969369.117009:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+13:2392:x1870627074057600:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 900us (3904us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1783969369.117018:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00002000:00100000:1.0:1783969369.117027:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff93eab73e1180 x1870627074057600/t4294967321(0) o4->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:265/0 lens 504/448 e 0 to 0 dl 1783969380 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783969369.117037:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab73e1180 with x1870627074057600 ext(0->12) 00002000:00010000:1.0:1783969369.117041:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93eab73e1180 00000100:00100000:3.0:1783969369.120927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969369.121078:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074057728 00000100:00100000:1.0:1783969369.121091:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074057728 00000100:00100000:1.0:1783969369.121174:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 244 00000100:00100000:1.0:1783969369.121187:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+73:12472:x1870627074057728:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783969369.126726:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:1.0:1783969369.126749:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1783969369.126805:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1783969369.126831:0:6500:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93e983419600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1783969369.126863:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eabf74bf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93e983419240 00000020:00080000:1.0:1783969369.126866:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eabf74b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93e983e83600 00000004:00080000:1.0:1783969369.126896:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1783969369.126927:0:6500:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93eaa5ad7cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1783969369.126930:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab737d300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93eaa5ad7240 00000020:00080000:1.0:1783969369.126933:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eab737d100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93e983f83000 00000020:00080000:1.0:1783969369.126944:0:6500:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1783969369.126966:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1783969369.127059:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783969369.127232:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12472:x1870627074057728:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 6040us (6312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969369.127244:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 244 00000100:00100000:2.0:1783969369.127792:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099275008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783969369.127873:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969369.127913:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969369.127919:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099274880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783969369.127940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969369.127972:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099275008 00000100:00100000:2.0:1783969369.127980:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099275008 00000100:00100000:2.0:1783969369.128036:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099274880 00000100:00100000:2.0:1783969369.128039:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099274880 00000100:00100000:2.0:1783969369.128061:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783969369.128069:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1870627099275008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783969369.128229:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783969369.128233:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1783969368 00002000:00010000:2.0:1783969369.128236:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783969369.128238:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1783969368 -> 1783969368 00002000:00010000:2.0:1783969369.128241:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1783969369.128275:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3647:x1870627099275008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (403us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1783969369.128294:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783969369.128542:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099275136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783969369.128583:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969369.128716:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099275136 00000100:00100000:2.0:1783969369.128720:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099275136 00000100:00100000:2.0:1783969369.128738:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783969369.128744:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1870627099274880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783969369.128763:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1783969369.128787:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.128815:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303af5 expref: 12 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.128824:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783969369.128830:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969369.128835:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.128869:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303af5 expref: 12 pid: 9974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.128885:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303af5 expref: 12 pid: 9974 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969369.128897:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1870627099275264:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969369.128957:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969369.128976:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783969369.128990:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3648:x1870627099275136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783969369.129003:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1783969369.129029:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a553657, atime: 0x6a553657, ctime: 0x6a553657, blocks: 0x8 00010000:00010000:2.0:1783969369.129035:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129044:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1783969369.129047:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969369.129053:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129071:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129081:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129088:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129108:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783969369.129241:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3648:x1870627099275136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 251us (657us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783969369.129248:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:2.0:1783969369.129268:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969369.129276:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129295:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969369.129315:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129326:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129346:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129353:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e29af5b8/0xea31253a47cbab04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.129378:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969369.129417:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969369.129420:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783969369.129430:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1783969369.129474:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93e983f8d500/2, rc 0, transno 4294967322 00000100:00100000:2.0:1783969369.129483:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099275008:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1783969369.129754:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93e983efdc00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1783969369.129761:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099275136:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783969369.130162:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130173:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130179:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130184:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969369.130188:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130207:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130222:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93ea911e6700) 00010000:00010000:0.0:1783969369.130225:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969369.130230:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130235:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cba7fb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130266:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130272:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130277:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130282:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafc00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969369.130284:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130290:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130297:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93e982170e00) 00010000:00010000:0.0:1783969369.130311:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969369.130314:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130329:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dafc00/0xea31253a47cba8a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130349:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130354:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130360:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130365:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969369.130368:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130375:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130419:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170000) 00010000:00010000:0.0:1783969369.130421:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969369.130424:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130429:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae600/0xea31253a47cba921 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130440:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130445:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130456:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130461:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de6200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969369.130464:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130470:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130477:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982170000) 00010000:00010000:0.0:1783969369.130480:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969369.130482:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130488:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cba944 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130506:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130512:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130517:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130522:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969369.130524:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130539:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130547:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969369.130549:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969369.130552:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130558:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbaa16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130569:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130575:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130581:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130586:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969369.130588:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130593:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130601:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:0.0:1783969369.130603:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783969369.130617:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.130632:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbaad3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969369.134831:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1870627099275264:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969369.134876:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969369.141450:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969369.141498:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969369.141594:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074057856 00000100:00100000:2.0:1783969369.141627:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074057856 00000100:00100000:2.0:1783969369.141702:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:2.0:1783969369.141713:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+13:2394:x1870627074057856:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783969369.142190:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074057984 00000100:00100000:0.0:1783969369.142196:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074057984 00010000:00010000:0.0:1783969369.142223:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303af5 expref: 14 pid: 9974 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.142290:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:0.0:1783969369.142306:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+14:2391:x1870627074057984:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969369.142321:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969369.142327:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303af5 expref: 14 pid: 9974 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.142342:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303af5 expref: 14 pid: 9974 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.142372:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cba8b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303af5 expref: 14 pid: 9974 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.142412:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969369.142417:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969369.142424:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.142437:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.142483:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969369.142556:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+13:2391:x1870627074057984:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 258us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969369.142565:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 103 00010000:00010000:2.0:1783969369.142698:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.142708:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.142719:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.142726:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.142753:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783969369.143489:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3647:x1870627099274880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14741us (15543us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1783969369.143501:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000004:00080000:2.0:1783969369.143568:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93e983f8ea00/2, rc 0, transno 4294967323 00000100:00100000:2.0:1783969369.143577:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099274880:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783969369.143770:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969369.143779:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.143792:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969369.143797:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.143809:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.143830:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.143839:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001663ef03/0xea31253a47cbaafd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.143863:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969369.143865:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969369.143867:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783969369.145038:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1783969369.145055:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1783969369.145450:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1783969369.145458:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1783969369.159034:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2394:x1870627074057856:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 17310us (17522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969369.159051:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:1.0:1783969369.165223:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.165340:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074058240 00000100:00100000:0.0:1783969369.165358:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074058240 00000100:00100000:0.0:1783969369.165474:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 245 00000100:00100000:0.0:1783969369.165486:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+21:12472:x1870627074058240:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783969369.165557:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969369.165598:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52a00/0xea31253a47cbaae8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b8f expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.165634:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:0.0:1783969369.165640:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969369.165684:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.165701:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.165715:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969369.165883:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000476648d4 reply state 000000001ba72b4c transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.165898:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.165905:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:0.0:1783969369.165908:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783969369.165911:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969369.166476:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+22:12472:x1870627074058240:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 986us (1259us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1783969369.166511:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 245 00000100:00100000:0.0:1783969369.173772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969369.173952:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074058368 00000100:00100000:2.0:1783969369.173965:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074058368 00000100:00100000:2.0:1783969369.174045:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:2.0:1783969369.174057:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074058368:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783969369.174264:0:14243:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1783969369.174286:0:14243:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1783969368 -> 1783969367 00002000:00010000:2.0:1783969369.174288:0:14243:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1783969367 00002000:00010000:2.0:1783969369.174291:0:14243:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1783969368 -> 1783969367 00002000:00010000:2.0:1783969369.174293:0:14243:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783969369.174413:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074058368:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 323us (620us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1783969369.174423:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:3.0:1783969369.176736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.184007:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074058624 00000100:00100000:0.0:1783969369.184027:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074058624 00000100:00100000:0.0:1783969369.184121:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 246 00000100:00100000:0.0:1783969369.184133:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+22:12472:x1870627074058624:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783969369.184234:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.184259:0:9027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b81 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.184272:0:9027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.184334:0:9027:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b81 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.184353:0:9027:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b81 expref: 22 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.184372:0:9027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099275392:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969369.184554:0:9027:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8780a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783969369.191148:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969369.193211:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074058752 00000100:00100000:3.0:1783969369.193232:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074058752 00010000:00010000:3.0:1783969369.193310:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b81 expref: 23 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969369.193427:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:3.0:1783969369.193439:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+23:2391:x1870627074058752:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969369.193462:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969369.193470:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b81 expref: 23 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.193487:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b81 expref: 23 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.193517:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:3.0:1783969369.193522:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.193533:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.193574:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.193601:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969369.193710:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+23:2391:x1870627074058752:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 271us (2570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969369.193718:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 104 00010000:00010000:0.0:1783969369.194566:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7000/0xea31253a47cbaacc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b81 expref: 22 pid: 6523 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.194590:0:9027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9027:1870627099275392:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969369.194641:0:9027:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.194652:0:9027:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.194660:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.194725:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.194734:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.194741:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.194748:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969369.194753:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.194761:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.194774:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:0.0:1783969369.194777:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783969369.194791:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.194798:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab12 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.194876:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+21:12472:x1870627074058624:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 10746us (18154us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783969369.194886:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 246 00000100:00100000:1.0:1783969369.199794:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969369.200430:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074058880 00000100:00100000:3.0:1783969369.200447:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074058880 00000100:00100000:3.0:1783969369.200527:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:3.0:1783969369.200541:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074058880:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783969369.200621:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.200650:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 8 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.200660:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969369.200666:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969369.200672:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.200726:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 8 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.200744:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 8 pid: 14243 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969369.200786:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1870627099275520:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969369.200923:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7315f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969369.207755:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1870627099275520:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969369.207799:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969369.219532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.219724:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074059008 00000100:00100000:0.0:1783969369.219738:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074059008 00010000:00010000:0.0:1783969369.219794:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 9 pid: 14243 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.219846:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:0.0:1783969369.219858:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+9:2391:x1870627074059008:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969369.219881:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969369.219912:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 9 pid: 14243 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.219931:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 9 pid: 14243 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.219962:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbc5eaf6/0xea31253a47cbaaf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b9d expref: 9 pid: 14243 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.219985:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969369.219990:0:7929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969369.219998:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.220033:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.220077:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969369.220159:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074059008:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 302us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969369.220167:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 105 00010000:00010000:2.0:1783969369.220853:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.220866:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.220894:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.220902:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.220911:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.220933:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969369.220937:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.220947:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.220963:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.220971:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbab19 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969369.221049:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074058880:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 20511us (21270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969369.221059:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:1.0:1783969369.231636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969369.234612:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074059264 00000100:00100000:2.0:1783969369.234635:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074059264 00000100:00100000:2.0:1783969369.234750:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 247 00000100:00100000:2.0:1783969369.234762:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+21:12472:x1870627074059264:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783969369.234873:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.234896:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b49 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.234930:0:13769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.234975:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b49 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.234991:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b49 expref: 21 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969369.235007:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099275648:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969369.235129:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969369.242826:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969369.242929:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099275648:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969369.242972:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.243074:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074059392 00000100:00100000:0.0:1783969369.243083:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074059392 00010000:00010000:0.0:1783969369.243137:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b49 expref: 22 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.243187:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:0.0:1783969369.243197:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab211a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+22:2392:x1870627074059392:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969369.243219:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969369.243227:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b49 expref: 22 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.243240:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b49 expref: 22 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.243266:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdfa00/0xea31253a47cbaa0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b49 expref: 22 pid: 6522 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.243285:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969369.243320:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b6c expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.243331:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.243339:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.243347:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.243378:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969369.243901:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab211a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+21:2392:x1870627074059392:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 702us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969369.243911:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 106 00010000:00010000:2.0:1783969369.244038:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.244048:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.244285:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.244367:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b88 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.244411:0:13769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.244464:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b88 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969369.244481:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b88 expref: 21 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969369.244497:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099275776:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969369.244562:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982235000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969369.267022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.267245:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099275776:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969369.267284:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969369.267695:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074059520 00000100:00100000:1.0:1783969369.267706:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074059520 00010000:00010000:1.0:1783969369.267763:0:7929:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b88 expref: 22 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969369.267815:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:1.0:1783969369.267841:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+22:2392:x1870627074059520:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969369.267859:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969369.267867:0:7929:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b88 expref: 22 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.267881:0:7929:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b88 expref: 22 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.267906:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbaada lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b88 expref: 22 pid: 6521 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.267927:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:1.0:1783969369.267932:0:7929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.267944:0:7929:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.267952:0:7929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.267982:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969369.268062:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+21:2392:x1870627074059520:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 221us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969369.268070:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 107 00010000:00010000:0.0:1783969369.268579:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.268590:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969369.268773:0:13769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1783969369.268919:0:13769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1783969369.268969:0:13769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1783969369.269073:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13769:1870627099275904:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783969369.273695:0:13769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969369.279673:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099275904 00000100:00100000:1.0:1783969369.279690:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099275904 00000100:00100000:1.0:1783969369.279754:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783969369.279764:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13769:x1870627099275904:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783969369.279910:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13769:x1870627099275904:12345-0@lo:1000:mdt00_005.0 Request processed in 146us (6221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969369.279918:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783969369.279955:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5b480c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969369.279991:0:13769:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1783969369.279998:0:13769:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1783969369.280032:0:13769:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93e983f8d500, transno 4294967322 00000100:00100000:1.0:1783969369.280054:0:13769:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff93e983f8ea00 x1870627099274880/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783969385 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969369.280067:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13769:1870627099275904:0@lo:1000:mdt00_005.0 00000001:00080000:1.0:1783969369.280213:0:13769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:1.0:1783969369.280298:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13769:1870627099276032:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783969369.280340:0:13769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969369.280375:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969369.280483:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099276032 00000100:00100000:3.0:1783969369.280497:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099276032 00000100:00100000:3.0:1783969369.280550:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783969369.280563:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13769:x1870627099276032:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783969369.281057:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13769:x1870627099276032:12345-0@lo:1000:mdt00_005.0 Request processed in 496us (715us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1783969369.281066:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1783969369.281484:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13769:1870627099276032:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1783969369.281544:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281555:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281564:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281581:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daea00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969369.281585:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281625:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281645:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:1.0:1783969369.281649:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969369.281654:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281661:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab27 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281702:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281709:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281716:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281721:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969369.281724:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281730:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281748:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:1.0:1783969369.281750:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969369.281759:0:13769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b6c expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281786:0:13769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b6c expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281796:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b6c expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.281835:0:13769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b6c expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969369.281849:0:13769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099276160:192.168.201.34@tcp:105: 00000100:00100000:1.0:1783969369.281950:0:13769:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419840 going to sleep for 11 seconds 00000100:00100000:1.0:1783969369.291400:0:13769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13769:1870627099276160:192.168.201.34@tcp:105: 00010000:00010000:1.0:1783969369.291448:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291462:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797a00/0xea31253a47cbaa6a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291510:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291528:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291543:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291555:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291581:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291588:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291595:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de7600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969369.291599:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291615:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291629:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:1.0:1783969369.291632:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969369.291636:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291641:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291652:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291659:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291664:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291669:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:1.0:1783969369.291688:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291702:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291711:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:1.0:1783969369.291714:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783969369.291717:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.291724:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae800/0xea31253a47cbab20 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969369.291969:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+24:12472:x1870627074059264:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 57206us (60342us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1783969369.291982:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 247 00000020:00080000:1.0:1783969369.291989:0:13769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783969369.292286:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969369.292292:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1783969369.292673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000040:00080000:3.0:1783969369.292820:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1783969369.292831:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783969369.293258:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074059648 00000100:00100000:1.0:1783969369.293272:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074059648 00000100:00100000:1.0:1783969369.293504:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1783969369.293517:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+24:12471:x1870627074059648:12345-192.168.201.34@tcp:49:lfs.0 00000100:00100000:1.0:1783969369.293876:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+24:12471:x1870627074059648:12345-192.168.201.34@tcp:49:lfs.0 Request processed in 362us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969369.293885:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:0.0:1783969369.303205:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969369.303311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969369.303436:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074059904 00000100:00100000:1.0:1783969369.303447:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074059904 00000100:00100000:1.0:1783969369.303508:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 248 00000100:00100000:1.0:1783969369.303522:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+24:12471:x1870627074059904:12345-192.168.201.34@tcp:58:lfs.0 00000100:00100000:3.0:1783969369.303556:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074060160 00000100:00100000:3.0:1783969369.303569:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074060160 00000100:00100000:3.0:1783969369.303645:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:3.0:1783969369.303658:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+25:12472:x1870627074060160:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1783969369.303740:0:7749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1783969369.303829:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+25:12471:x1870627074059904:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 308us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969369.303840:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 248 00000004:00080000:3.0:1783969369.304412:0:6525:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783969369.304454:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1783969369.304493:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.304514:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.304550:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.304561:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.304568:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.304575:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.304601:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969369.304643:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969369.304655:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.304667:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969369.304672:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.304683:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969369.304722:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+26:12472:x1870627074060160:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1064us (1407us total) trans 4294967517 rc 0/0 00010000:00010000:1.0:1783969369.305100:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:1.0:1783969369.305106:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783969369.305112:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.305120:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53800/0xea31253a47cbab35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.305137:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969369.305139:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969369.305141:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969369.311212:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000020:00080000:3.0:1783969369.311235:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783969369.370290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969369.370553:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074060288 00000100:00100000:1.0:1783969369.370569:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074060288 00000100:00100000:1.0:1783969369.370668:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 249 00000100:00100000:1.0:1783969369.370680:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+26:12474:x1870627074060288:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1783969369.370721:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969369.370743:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303ba4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.370812:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.370827:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.370983:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.371001:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.371009:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.371015:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.371094:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.371106:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b65 expref: 27 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.371114:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.371237:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b65 expref: 27 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969369.371259:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b65 expref: 27 pid: 13769 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969369.371273:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099276288:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969369.371535:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969369.379746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969369.379848:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074060544 00000100:00100000:1.0:1783969369.379859:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074060544 00000100:00100000:1.0:1783969369.379919:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:1.0:1783969369.379929:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+28:6163:x1870627074060544:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783969369.380275:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+29:6163:x1870627074060544:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 346us (537us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1783969369.380286:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1783969369.384937:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969369.385041:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074060672 00000100:00100000:3.0:1783969369.385058:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074060672 00010000:00010000:3.0:1783969369.385117:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b65 expref: 29 pid: 13769 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969369.385163:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:3.0:1783969369.385173:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+29:2392:x1870627074060672:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969369.385193:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969369.385202:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b65 expref: 29 pid: 13769 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.385242:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b65 expref: 29 pid: 13769 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.385269:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:3.0:1783969369.385275:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.385286:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.385295:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969369.385321:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969369.385560:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+29:2392:x1870627074060672:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 387us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969369.385569:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 108 00010000:00010000:0.0:1783969369.392702:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796400/0xea31253a47cbaa5c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b65 expref: 28 pid: 13769 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969369.392730:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1870627099276288:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969369.392758:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392769:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392776:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969369.392846:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783969369.392850:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969369.392873:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392890:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392901:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392909:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392936:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392943:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de6800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969369.392947:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392955:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392971:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:0.0:1783969369.392975:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969369.392982:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.392990:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbab43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393005:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393013:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393020:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393025:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de6a00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969369.393028:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393048:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393059:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93e982253400) 00010000:00010000:0.0:1783969369.393072:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969369.393076:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393082:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6a00/0xea31253a47cbab4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393129:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7600/0xea31253a47cbab3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ba4 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393160:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ba4 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969369.393170:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969369.393172:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969369.393175:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6400, rc 0) 00000100:00100000:0.0:1783969369.393260:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12474:x1870627074060288:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 22580us (22985us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969369.393269:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 249 00010000:00010000:2.0:1783969369.918079:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969369.969683:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099276416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969369.969761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969369.969835:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099276416 00000100:00100000:3.0:1783969369.969842:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099276416 00000100:00100000:3.0:1783969369.969901:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1783969369.969911:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099276416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969369.969947:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783969369.969997:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099276416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969369.970005:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1783969369.970068:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099276416:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1783969370.356827:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969370.356840:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969370.356883:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783969370.356892:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969370.357084:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099276544:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783969370.357239:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e80f480 going to sleep for 11 seconds 00000100:00100000:0.0:1783969370.362409:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13807:1870627099276544:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783969370.365605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969370.366352:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074060800 00000100:00100000:1.0:1783969370.366367:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074060800 00000100:00100000:1.0:1783969370.366498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 250 00000100:00100000:1.0:1783969370.366510:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12486:x1870627074060800:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783969370.366578:0:6523:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783969370.366848:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12486:x1870627074060800:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 340us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969370.366858:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 250 00000100:00080000:0.0:1783969370.369449:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969370.382417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969370.382649:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074061056 00000100:00100000:0.0:1783969370.382674:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074061056 00000100:00100000:0.0:1783969370.382767:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 251 00000100:00100000:0.0:1783969370.382780:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+27:12486:x1870627074061056:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969370.382814:0:7749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969370.382844:0:7749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab58 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303bab expref: -99 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.383007:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cbab5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.383028:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cbab5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.383044:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cbab5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969370.383060:0:7749:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783969370.383220:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab58 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bab expref: 30 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.383245:0:7749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cbab5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bab expref: 29 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.383256:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969370.383272:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969370.383277:0:7749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdee00, rc 0) 00000100:00100000:0.0:1783969370.383367:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+29:12486:x1870627074061056:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 590us (988us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1783969370.383376:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 251 00000100:00100000:2.0:1783969370.398003:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969370.398153:0:7929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074061184 00000100:00100000:3.0:1783969370.398166:0:7929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074061184 00000100:00100000:3.0:1783969370.398251:0:7929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1783969370.398263:0:7929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+29:2392:x1870627074061184:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969370.398284:0:7929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969370.398317:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdee00/0xea31253a47cbab5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bab expref: 29 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969370.398339:0:7929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:3.0:1783969370.398344:0:7929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969370.398435:0:7929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+28:2392:x1870627074061184:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 175us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969370.398444:0:7929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1783969370.399959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969370.400124:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074061440 00000100:00100000:2.0:1783969370.400135:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074061440 00000100:00100000:2.0:1783969370.400202:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 252 00000100:00100000:2.0:1783969370.400212:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+28:12486:x1870627074061440:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783969370.400323:0:9027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.400346:0:9027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.400361:0:9027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.400611:0:9027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.400627:0:9027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.400635:0:9027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.400642:0:9027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969370.400647:0:9027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.400655:0:9027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.400669:0:9027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:2.0:1783969370.400780:0:9027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969370.400787:0:9027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.400795:0:9027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae000/0xea31253a47cbab6d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9027 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969370.400949:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+29:12486:x1870627074061440:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 735us (999us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1783969370.400959:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 252 00000040:00080000:1.0:1783969370.401554:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969370.401561:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969370.402066:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783969370.402080:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969370.410328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969370.410531:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074061696 00000100:00100000:1.0:1783969370.410545:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074061696 00000100:00100000:1.0:1783969370.410639:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:1.0:1783969370.410652:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+29:12486:x1870627074061696:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783969370.410942:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+30:12486:x1870627074061696:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 293us (627us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1783969370.410951:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000040:00080000:2.0:1783969370.448463:0:14729:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783969370.448477:0:14729:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783969370.448513:0:14729:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783969370.448523:0:14729:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969370.481714:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099276672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969370.481815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.481950:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099276672 00000100:00100000:1.0:1783969370.481960:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099276672 00000100:00100000:1.0:1783969370.482034:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783969370.482046:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099276672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969370.482094:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969370.482156:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099276672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969370.482163:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1783969370.482795:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099276672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969370.756597:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969370.758193:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074061952 00000100:00100000:0.0:1783969370.758210:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074061952 00000100:00100000:0.0:1783969370.758283:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 253 00000100:00100000:0.0:1783969370.758292:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+30:12499:x1870627074061952:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969370.758318:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969370.758343:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbab74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303bb2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.758479:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab7b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.758497:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.758509:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969370.758521:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783969370.758643:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf800/0xea31253a47cbab74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bb2 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.758676:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bb2 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.758685:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969370.758689:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783969370.758691:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde600, rc 0) 00000100:00100000:0.0:1783969370.758761:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+32:12499:x1870627074061952:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 470us (2187us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1783969370.758768:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 253 00000100:00100000:0.0:1783969370.771698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969370.771739:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074062080 00000100:00100000:0.0:1783969370.771750:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074062080 00000100:00100000:0.0:1783969370.771818:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 254 00000100:00100000:0.0:1783969370.771829:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+32:12499:x1870627074062080:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1783969370.771903:0:7749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.771922:0:7749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.771935:0:7749:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.771974:0:7749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.771981:0:7749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.772002:0:7749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.772008:0:7749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf200 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969370.772013:0:7749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.772020:0:7749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.772035:0:7749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:0.0:1783969370.772037:0:7749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969370.772042:0:7749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969370.772048:0:7749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf200/0xea31253a47cbab89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7749 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969370.772119:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+32:12499:x1870627074062080:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 291us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969370.772126:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 254 00000100:00100000:3.0:1783969370.871477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969370.871682:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074062208 00000100:00100000:1.0:1783969370.871694:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074062208 00000100:00100000:2.0:1783969370.871880:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:2.0:1783969370.871896:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2392:x1870627074062208:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1783969370.871932:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969370.871968:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004472757e/0xea31253a47cbab90 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303bb9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969370.871997:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a553657, atime: 0x6a553657, ctime: 0x6a553657, blocks: 0x8 00010000:00010000:2.0:1783969370.872019:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1783969370.872024:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969370.872034:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004472757e/0xea31253a47cbab90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bb9 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.872052:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004472757e/0xea31253a47cbab90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bb9 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969370.872066:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae000, rc 0) 00000100:00100000:2.0:1783969370.872143:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2392:x1870627074062208:12345-192.168.201.34@tcp:101:cat.0 Request processed in 249us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969370.872150:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:0.0:1783969370.886612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969370.887423:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074062336 00000100:00100000:2.0:1783969370.887438:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074062336 00002000:00100000:2.0:1783969370.887512:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93eab73e2a00 x1870627074062336/t0(0) o3->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:266/0 lens 488/0 e 0 to 0 dl 1783969381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969370.887524:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab73e2a00 with x1870627074062336 ext(0->4095) 00002000:00010000:2.0:1783969370.887531:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93eab73e2a00 00000100:00100000:2.0:1783969370.887563:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1783969370.887574:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2393:x1870627074062336:12345-192.168.201.34@tcp:3:cat.0 00000100:00100000:2.0:1783969370.888272:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2393:x1870627074062336:12345-192.168.201.34@tcp:3:cat.0 Request processed in 696us (1672us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783969370.888284:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00002000:00100000:2.0:1783969370.888293:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93eab73e2a00 x1870627074062336/t0(0) o3->c481ab09-d97e-4adb-b42e-68f98b038d20@192.168.201.34@tcp:266/0 lens 488/4536 e 0 to 0 dl 1783969381 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969370.888301:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff93eab73e2a00 with x1870627074062336 ext(0->4095) 00002000:00010000:2.0:1783969370.888305:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93eab73e2a00 00010000:00010000:0.0:1783969370.930932:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969370.992745:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969370.992789:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099276800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969370.992886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969370.992926:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099276928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969370.992957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969370.992987:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099276800 00000100:00100000:3.0:1783969370.992997:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099276800 00000100:00100000:3.0:1783969370.993056:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099276928 00000100:00100000:3.0:1783969370.993059:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099276928 00000100:00100000:3.0:1783969370.993090:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783969370.993099:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1870627099276800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969370.993156:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783969370.993208:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1870627099276800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969370.993216:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783969370.993235:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783969370.993241:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099276928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783969370.993251:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783969370.993271:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099276928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969370.993277:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1783969370.993299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969370.993341:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099276800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969370.993615:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099277184:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.993653:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.993676:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099277696:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.993698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.993724:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099278208:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.993746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.993765:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783969370.993771:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099277312:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.993797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.993826:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099277824:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.993848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.993862:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099278336:0@lo:400:kworker.0 00000100:00100000:0.0:1783969370.993893:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099276928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969370.993909:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099277440:0@lo:400:kworker.0 00000100:00100000:2.0:1783969370.993942:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099277184 00000100:00100000:2.0:1783969370.993947:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099277184 00000100:00100000:2.0:1783969370.993986:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099277696 00000100:00100000:2.0:1783969370.993989:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099277696 00000100:00100000:2.0:1783969370.994012:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099278208 00000100:00100000:2.0:1783969370.994016:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099278208 00000100:00100000:2.0:1783969370.994029:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099277824 00000100:00100000:2.0:1783969370.994032:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099277824 00000100:00100000:2.0:1783969370.994047:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1783969370.994053:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099277184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969370.994118:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099277056:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.998175:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.998276:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099278336 00000100:00100000:1.0:1783969370.998288:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099278336 00000100:00100000:1.0:1783969370.998362:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1783969370.998375:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099277696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.998478:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099277696:12345-0@lo:400:kworker.0 Request processed in 106us (4778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969370.998487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1783969370.998511:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1783969370.998519:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099278208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.998548:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099278208:12345-0@lo:400:kworker.0 Request processed in 30us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969370.998554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1783969370.998901:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1783969370.998911:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099277824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.998948:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099277824:12345-0@lo:400:kworker.0 Request processed in 40us (5099us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969370.998955:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1783969370.998969:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1783969370.998975:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099278336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.999004:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099278336:12345-0@lo:400:kworker.0 Request processed in 30us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969370.999036:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1783969370.999064:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099277312 00000100:00100000:1.0:1783969370.999069:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099277312 00000100:00100000:1.0:1783969370.999112:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783969370.999117:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099277312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.999153:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099277312:12345-0@lo:400:kworker.0 Request processed in 36us (5356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969370.999159:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783969370.999210:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099277312:0@lo:400:kworker.0 00010000:00080000:1.0:1783969370.999227:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea865a8e00 x1870627099277824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969370.999239:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099277824:0@lo:400:kworker.0 00010000:00080000:1.0:1783969370.999250:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea865a8a80 x1870627099278336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969370.999259:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099278336:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.999269:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099277696:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.999280:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099278208:0@lo:400:kworker.0 00000100:00100000:1.0:1783969371.003427:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969371.003483:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099277440 00000100:00100000:1.0:1783969371.003493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099277440 00000100:00100000:1.0:1783969371.003558:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1783969371.003591:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099277440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969371.003658:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099277440:12345-0@lo:400:kworker.0 Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969371.003685:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1783969371.003788:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099277440:0@lo:400:kworker.0 00000100:00100000:1.0:1783969371.003804:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099277952:0@lo:400:kworker.0 00000100:00100000:1.0:1783969371.003851:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969371.004081:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099277952 00000100:00100000:1.0:1783969371.004086:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099277952 00000100:00100000:1.0:1783969371.004130:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783969371.004138:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099277952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969371.004176:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099277952:12345-0@lo:400:kworker.0 Request processed in 39us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969371.004183:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783969371.004207:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099277952:0@lo:400:kworker.0 00000100:00080000:1.0:1783969371.004240:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969371.004246:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969371.004249:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969371.006531:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099277184:12345-0@lo:400:kworker.0 Request processed in 12466us (12866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969371.006550:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1783969371.006665:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099277184:0@lo:400:kworker.0 00000100:00100000:3.0:1783969371.008349:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969371.008496:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099277568:0@lo:400:kworker.0 00000100:00100000:3.0:1783969371.008538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969371.008591:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099277568 00000100:00100000:3.0:1783969371.008601:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099277568 00000100:00100000:3.0:1783969371.008660:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783969371.008681:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099277568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969371.008744:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099277568:12345-0@lo:400:kworker.0 Request processed in 65us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969371.008753:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783969371.009002:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099277568:0@lo:400:kworker.0 00000100:00100000:3.0:1783969371.009011:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099278080:0@lo:400:kworker.0 00000100:00100000:3.0:1783969371.009058:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969371.009127:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099278080 00000100:00100000:3.0:1783969371.009131:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099278080 00000100:00100000:3.0:1783969371.009171:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783969371.009177:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099278080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969371.009215:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099278080:12345-0@lo:400:kworker.0 Request processed in 38us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969371.009222:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1783969371.009238:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969371.009257:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1783969371.009265:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1783969371.009284:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93e983699c00, transno 4294967308 00000004:00080000:3.0:1783969371.009296:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1783969371.009309:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93e983efdc00, transno 4294967311 00000100:00100000:3.0:1783969371.009317:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099278080:0@lo:400:kworker.0 00000100:00100000:2.0:1783969371.011531:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099277056 00000100:00100000:2.0:1783969371.011551:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099277056 00000100:00100000:2.0:1783969371.011898:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1783969371.011915:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099277056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969371.012042:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099277056:12345-0@lo:400:kworker.0 Request processed in 132us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969371.012069:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1783969371.012240:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099277056:0@lo:400:kworker.0 00000100:00100000:3.0:1783969371.505249:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099278592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969371.505448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969371.505541:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099278464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783969371.505575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969371.505620:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099278592 00000100:00100000:0.0:1783969371.505664:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099278592 00000100:00100000:1.0:1783969371.505668:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099278464 00000100:00100000:1.0:1783969371.505673:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099278464 00000100:00100000:0.0:1783969371.505728:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783969371.505748:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099278592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969371.505790:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969371.505942:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099278592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969371.506021:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099278592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969371.514348:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783969371.514424:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099278464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969371.514468:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969371.514600:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099278464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 234us (9031us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969371.514609:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783969371.514912:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099278464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969371.516197:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00010000:00010000:1.0:1783969371.952633:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969372.943334:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969372.943417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969372.943446:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969372.943480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969372.943505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969372.943527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969372.943562:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969372.943593:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074062592 00000100:00100000:0.0:1783969372.943602:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074062592 00000100:00100000:0.0:1783969372.943670:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074063104 00000100:00100000:0.0:1783969372.943674:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074063104 00000100:00100000:0.0:1783969372.943696:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074062720 00000100:00100000:0.0:1783969372.943699:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074062720 00000100:00100000:0.0:1783969372.943715:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074063232 00000100:00100000:0.0:1783969372.943718:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074063232 00000100:00100000:0.0:1783969372.943738:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 375 00000100:00100000:0.0:1783969372.943748:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+32:2391:x1870627074062592:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969372.943855:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+32:2391:x1870627074062592:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 106us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969372.943866:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 375 00000100:00100000:0.0:1783969372.943888:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 376 00000100:00100000:0.0:1783969372.943909:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074063104:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969372.943941:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074063104:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969372.943947:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 376 00000100:00100000:0.0:1783969372.943962:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 377 00000100:00100000:0.0:1783969372.943968:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074062720:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969372.943992:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074062720:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969372.944001:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 377 00000100:00100000:0.0:1783969372.944012:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 378 00000100:00100000:0.0:1783969372.944020:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074063232:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969372.944040:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074063232:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969372.944048:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 378 00000100:00100000:0.0:1783969372.944070:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074062464 00000100:00100000:0.0:1783969372.944073:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074062464 00000100:00100000:0.0:1783969372.944102:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 405 00000100:00100000:0.0:1783969372.944111:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074062464:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969372.944134:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074062464:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969372.944141:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 405 00000100:00100000:0.0:1783969372.944179:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074062848 00000100:00100000:0.0:1783969372.944183:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074062848 00000100:00100000:0.0:1783969372.944214:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074062976 00000100:00100000:0.0:1783969372.944223:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074062976 00000100:00100000:0.0:1783969372.944253:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:0.0:1783969372.944259:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074062848:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969372.944365:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074062848:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 106us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969372.944373:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:0.0:1783969372.944406:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:0.0:1783969372.944412:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074062976:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969372.944437:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+8:2391:x1870627074062976:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969372.944443:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00080000:3.0:1783969372.945118:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969372.945123:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969372.945125:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969372.945127:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783969372.980075:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969374.000628:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783969374.589218:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1783969374.589240:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1783969374.594504:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1783969374.596529:0:6500:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93e983419e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1783969374.596540:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eabf74b100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93e983419a80 00000020:00080000:3.0:1783969374.596553:0:6500:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff93eabf74b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ea82e9ca00 00000020:00080000:3.0:1783969374.596673:0:6500:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1783969374.596692:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1783969374.596776:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1783969374.599495:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969374.599513:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969374.599531:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969374.599538:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969374.599544:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969374.599553:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969374.599574:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93e982253e00) 00010000:00010000:2.0:1783969374.599577:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969374.599583:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969374.599589:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde400/0xea31253a47cbab0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969375.024926:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969375.088796:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969375.088824:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099278720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969375.088947:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969375.089123:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099278720 00000100:00100000:1.0:1783969375.089132:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099278720 00000100:00100000:1.0:1783969375.089187:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783969375.089197:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099278720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969375.089232:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783969375.089292:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099278720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969375.089300:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1783969375.089421:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099278720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969375.601582:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099278848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969375.601663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969375.601854:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099278848 00000100:00100000:1.0:1783969375.601864:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099278848 00000100:00100000:1.0:1783969375.601924:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783969375.601933:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099278848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969375.601974:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969375.602049:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099278848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969375.602056:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783969375.602146:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099278848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783969376.049169:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969376.112791:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969376.112815:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099278976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969376.112887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969376.112952:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099278976 00000100:00100000:0.0:1783969376.112959:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099278976 00000100:00100000:0.0:1783969376.113048:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783969376.113057:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099278976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969376.113091:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783969376.113136:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099278976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.113144:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1783969376.113164:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969376.113200:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1783969376.113206:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93e983f8ea00, transno 4294967323 00000004:00080000:0.0:1783969376.113232:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1783969376.113369:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099279104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969376.113422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969376.113501:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099278976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969376.113761:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099279104 00000100:00100000:0.0:1783969376.113767:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099279104 00000100:00100000:0.0:1783969376.114725:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783969376.114735:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099279104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969376.114758:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783969376.114819:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099279104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.114825:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783969376.114945:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099279232:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.114982:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969376.115009:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099279744:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.115032:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969376.115049:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099280256:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.115070:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969376.115090:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783969376.115095:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099279616:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.115118:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969376.115134:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099280128:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.115151:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969376.115175:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099279232 00000100:00100000:0.0:1783969376.115180:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099279232 00000100:00100000:0.0:1783969376.115208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1783969376.115214:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099279232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.115267:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099279232:12345-0@lo:400:kworker.0 Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.115273:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1783969376.115301:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099279744 00000100:00100000:0.0:1783969376.115304:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099279744 00000100:00100000:0.0:1783969376.115326:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1783969376.115332:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099279744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.115362:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099279744:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.115368:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1783969376.115405:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099280256 00000100:00100000:0.0:1783969376.115408:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099280256 00000100:00100000:2.0:1783969376.115945:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099279488:0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.115983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969376.116005:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099280000:0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.116027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969376.116049:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099280512:0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.116068:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969376.116087:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783969376.116093:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099279360:0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.116114:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969376.116129:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099279872:0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.116147:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969376.116163:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099280384:0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.116184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969376.116212:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099279616 00000100:00100000:2.0:1783969376.116217:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099279616 00000100:00100000:2.0:1783969376.116244:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099280000 00000100:00100000:2.0:1783969376.116248:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099280000 00000100:00080000:3.0:1783969376.129036:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969376.129048:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969376.129051:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969376.129117:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099280512 00000100:00100000:3.0:1783969376.129130:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099280512 00000100:00100000:3.0:1783969376.129210:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099279360 00000100:00100000:3.0:1783969376.129214:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099279360 00000100:00100000:3.0:1783969376.129227:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099279872 00000100:00100000:3.0:1783969376.129229:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099279872 00000100:00100000:3.0:1783969376.129244:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099280384 00000100:00100000:3.0:1783969376.129246:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099280384 00000100:00100000:3.0:1783969376.129327:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1783969376.129337:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099279616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969376.129448:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099279616:12345-0@lo:400:kworker.0 Request processed in 113us (14328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969376.129455:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1783969376.129473:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1783969376.129479:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099280512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.129791:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099280128 00000100:00100000:0.0:1783969376.129796:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099280128 00000100:00100000:0.0:1783969376.129819:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783969376.129826:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099280256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.129862:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099280256:12345-0@lo:400:kworker.0 Request processed in 37us (14791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.129867:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783969376.129880:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783969376.129886:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099280128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.129911:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099280128:12345-0@lo:400:kworker.0 Request processed in 26us (14759us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.129917:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783969376.129938:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1783969376.129945:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099279360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.129996:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099279360:12345-0@lo:400:kworker.0 Request processed in 51us (13880us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.130002:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1783969376.130017:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1783969376.130022:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099279872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.130048:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099279872:12345-0@lo:400:kworker.0 Request processed in 26us (13900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.130054:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1783969376.130065:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1783969376.130070:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099280384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.130095:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099280384:12345-0@lo:400:kworker.0 Request processed in 24us (13909us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.130100:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1783969376.130126:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099279488 00000100:00100000:0.0:1783969376.130129:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099279488 00000100:00100000:0.0:1783969376.130146:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783969376.130151:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099279488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.130181:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099279488:12345-0@lo:400:kworker.0 Request processed in 29us (14197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969376.130187:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783969376.130244:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099279104:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783969376.130410:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969376.130411:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099279360:0@lo:400:kworker.0 00000100:00080000:1.0:1783969376.130416:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969376.130420:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969376.130429:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099279872:0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.130441:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099280384:0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.130465:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099279488:0@lo:400:kworker.0 00000100:00100000:3.0:1783969376.130474:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099280512:12345-0@lo:400:kworker.0 Request processed in 85us (13494us total) trans 0 rc 0/0 00010000:00080000:2.0:1783969376.130482:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e6300 x1870627099280512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969376.130506:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1783969376.130515:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099280512:0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.130602:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1783969376.130610:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099280000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969376.130653:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099280000:12345-0@lo:400:kworker.0 Request processed in 44us (14625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969376.130661:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00080000:2.0:1783969376.130685:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea889e6680 x1870627099280000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969376.130695:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099280000:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.130848:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099279616:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.130861:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099280128:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.130871:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099279232:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.130895:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099279744:0@lo:400:kworker.0 00000100:00100000:0.0:1783969376.130908:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099280256:0@lo:400:kworker.0 00000040:00080000:0.0:1783969376.560836:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969376.560847:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969376.560868:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783969376.560874:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783969376.635777:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969376.635801:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099280640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969376.635875:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969376.635936:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099280640 00000100:00100000:1.0:1783969376.635944:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099280640 00000100:00100000:1.0:1783969376.635988:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783969376.635995:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099280640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969376.636024:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969376.636081:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099280640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969376.636090:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783969376.636138:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099280640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969376.636358:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099280768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969376.636422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969376.636825:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099280768 00000100:00100000:3.0:1783969376.636831:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099280768 00000100:00100000:3.0:1783969376.636871:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783969376.636879:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099280768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969376.636895:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783969376.636942:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099280768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969376.636949:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783969376.637143:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099280768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783969377.057977:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969377.058076:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074063360 00000100:00100000:0.0:1783969377.058089:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074063360 00000100:00100000:0.0:1783969377.058173:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 255 00000100:00100000:0.0:1783969377.058186:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+18:12160:x1870627074063360:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783969377.058302:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c481ab09-d97e-4adb-b42e-68f98b038d20+18:12160:x1870627074063360:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 119us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969377.058309:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 255 00000100:00080000:1.0:1783969377.058644:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969377.066817:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969377.067012:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074063488 00000100:00100000:2.0:1783969377.067021:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074063488 00000100:00100000:2.0:1783969377.067164:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 256 00000100:00100000:2.0:1783969377.067176:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:12160:x1870627074063488:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783969377.067304:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:12160:x1870627074063488:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 131us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969377.067314:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 256 00010000:00010000:0.0:1783969377.072695:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783969377.073078:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1783969377.073520:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969377.076608:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969377.076735:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074063744 00000100:00100000:0.0:1783969377.076751:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074063744 00000100:00100000:0.0:1783969377.076908:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:0.0:1783969377.076922:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+18:12160:x1870627074063744:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783969377.077824:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+19:12160:x1870627074063744:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 891us (1220us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1783969377.077836:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:3.0:1783969377.294049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969377.294174:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074063872 00000100:00100000:2.0:1783969377.294192:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074063872 00000100:00100000:2.0:1783969377.294361:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 257 00000100:00100000:2.0:1783969377.294443:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:12956:x1870627074063872:12345-192.168.201.34@tcp:101:lsof.0 00010000:00010000:2.0:1783969377.294467:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969377.294497:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303bc0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969377.294564:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cbab9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969377.294580:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cbab9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969377.294592:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cbab9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969377.294641:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783969377.294646:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969377.294666:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cbab9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969377.294703:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daea00/0xea31253a47cbab97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bc0 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969377.294725:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cbab9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bc0 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969377.294733:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253200) 00010000:00010000:2.0:1783969377.294735:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969377.294739:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae400, rc 0) 00000100:00100000:2.0:1783969377.294810:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:12956:x1870627074063872:12345-192.168.201.34@tcp:101:lsof.0 Request processed in 372us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969377.294829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 257 00000100:00080000:1.0:1783969377.294912:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969378.059546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969378.059637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969378.060208:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074064000 00000100:00100000:0.0:1783969378.060223:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074064000 00000100:00100000:0.0:1783969378.060295:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 407 00000100:00100000:0.0:1783969378.060319:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2394:x1870627074064000:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969378.060448:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2394:x1870627074064000:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 131us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969378.060456:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 407 00000100:00100000:1.0:1783969378.060767:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074064128 00000100:00100000:1.0:1783969378.060773:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074064128 00000100:00100000:1.0:1783969378.060821:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 385 00000100:00100000:1.0:1783969378.060828:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:2394:x1870627074064128:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969378.060884:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:2394:x1870627074064128:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 56us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969378.060892:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 385 00000100:00100000:3.0:1783969378.069991:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969378.070132:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969378.070169:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969378.070238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969378.070296:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074064640 00000100:00100000:1.0:1783969378.070307:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074064640 00000100:00080000:3.0:1783969378.070365:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969378.070411:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074064256 00000100:00100000:1.0:1783969378.070415:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074064256 00000100:00100000:1.0:1783969378.070447:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 386 00000100:00100000:1.0:1783969378.070459:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627074064640:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969378.070496:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 387 00000100:00100000:3.0:1783969378.070509:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627074064256:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969378.070567:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2393:x1870627074064640:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 110us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969378.070575:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 386 00000100:00100000:3.0:1783969378.070684:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627074064256:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 178us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969378.070691:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 387 00000100:00100000:0.0:1783969378.071790:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074064384 00000100:00100000:0.0:1783969378.071800:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074064384 00000100:00080000:3.0:1783969378.071854:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969378.071863:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074064512 00000100:00100000:0.0:1783969378.071867:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074064512 00000100:00080000:3.0:1783969378.071887:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969378.071915:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:3.0:1783969378.071923:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:0.0:1783969378.071928:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627074064384:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969378.071938:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074064512:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969378.071992:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2393:x1870627074064384:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 68us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969378.071994:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2393:x1870627074064512:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 58us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969378.072010:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:3.0:1783969378.072020:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 148 00010000:00010000:1.0:1783969378.097635:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969379.121239:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969380.148498:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969380.209041:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099280896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969380.209147:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969380.209450:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099280896 00000100:00100000:0.0:1783969380.209460:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099280896 00000100:00100000:0.0:1783969380.209528:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783969380.209539:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099280896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969380.209584:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1783969380.209655:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099280896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969380.209663:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1783969380.209903:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099280896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969380.720900:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969380.720949:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099281024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969380.721042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969380.721126:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099281024 00000100:00100000:1.0:1783969380.721135:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099281024 00000100:00100000:1.0:1783969380.721184:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783969380.721193:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099281024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969380.721236:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969380.721284:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099281024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969380.721291:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783969380.721343:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099281024:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1783969380.752501:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:1.0:1783969380.752537:0:6500:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1783969380.752619:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1783969380.752639:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1783969381.176793:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969381.233598:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099281280:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.233678:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.233731:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099281792:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.233755:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.233776:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099282304:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.233797:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.233822:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1783969381.233829:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099281152:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.233857:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.233888:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099281664:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.233961:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.233982:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099282176:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234007:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.234023:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099282688:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234043:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.234073:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099281408:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.234117:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099281920:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.234174:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099282432:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.234214:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783969381.234220:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099281536:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.234257:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099282048:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.234296:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099282560:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969381.234350:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099281280 00000100:00100000:2.0:1783969381.234358:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099281280 00000100:00100000:2.0:1783969381.234436:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1783969381.234446:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099281280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234503:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099281280:12345-0@lo:400:kworker.0 Request processed in 59us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.234510:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1783969381.234529:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099281792 00000100:00100000:2.0:1783969381.234531:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099281792 00000100:00100000:2.0:1783969381.234558:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099282304 00000100:00100000:2.0:1783969381.234561:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099282304 00000100:00100000:2.0:1783969381.234575:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099281920 00000100:00100000:2.0:1783969381.234577:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099281920 00000100:00100000:2.0:1783969381.234588:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099282432 00000100:00100000:2.0:1783969381.234590:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099282432 00000100:00100000:2.0:1783969381.234598:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099281536 00000100:00100000:2.0:1783969381.234600:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099281536 00000100:00100000:2.0:1783969381.234611:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1783969381.234622:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099281792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099281792:12345-0@lo:400:kworker.0 Request processed in 31us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.234658:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1783969381.234671:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1783969381.234676:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099282304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234702:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099282304:12345-0@lo:400:kworker.0 Request processed in 26us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.234707:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1783969381.234719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1783969381.234725:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099281920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234752:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099281920:12345-0@lo:400:kworker.0 Request processed in 28us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.234758:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1783969381.234767:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1783969381.234772:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099282432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234795:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099282432:12345-0@lo:400:kworker.0 Request processed in 22us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.234800:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1783969381.234809:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1783969381.234815:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099281536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234839:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099281536:12345-0@lo:400:kworker.0 Request processed in 24us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.234844:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1783969381.234866:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099281664 00000100:00100000:2.0:1783969381.234874:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099281664 00000100:00100000:2.0:1783969381.234892:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099281408 00000100:00100000:2.0:1783969381.234894:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099281408 00000100:00100000:2.0:1783969381.234905:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783969381.234910:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099281664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234942:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099281664:12345-0@lo:400:kworker.0 Request processed in 32us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.234948:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783969381.234960:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783969381.234966:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099281408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.234993:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099281408:12345-0@lo:400:kworker.0 Request processed in 27us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.234998:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783969381.235015:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099282176 00000100:00100000:2.0:1783969381.235019:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099282176 00000100:00100000:2.0:1783969381.235043:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099282688 00000100:00100000:2.0:1783969381.235046:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099282688 00000100:00100000:2.0:1783969381.235058:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099282048 00000100:00100000:2.0:1783969381.235060:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099282048 00000100:00100000:2.0:1783969381.235071:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099282560 00000100:00100000:2.0:1783969381.235073:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099282560 00000100:00100000:2.0:1783969381.235085:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783969381.235091:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099282176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235123:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099282176:12345-0@lo:400:kworker.0 Request processed in 32us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.235129:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783969381.235140:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783969381.235145:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099282688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235180:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099282688:12345-0@lo:400:kworker.0 Request processed in 35us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.235186:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783969381.235198:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783969381.235203:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099282048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235228:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099282048:12345-0@lo:400:kworker.0 Request processed in 24us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.235234:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783969381.235244:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783969381.235249:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099282560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235271:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099282560:12345-0@lo:400:kworker.0 Request processed in 23us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.235276:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1783969381.235305:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969381.235309:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969381.235311:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969381.235314:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969381.235348:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099281536:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099282048:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235367:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099282560:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235376:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea8896aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099281408:0@lo:400:kworker.0 00010000:00080000:2.0:1783969381.235430:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319e680 x1870627099281920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969381.235442:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099281920:0@lo:400:kworker.0 00010000:00080000:2.0:1783969381.235462:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319f800 x1870627099282432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969381.235470:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099282432:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235517:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099281664:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235528:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099282176:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235538:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099282688:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235550:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099281280:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235559:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099281792:0@lo:400:kworker.0 00000100:00100000:2.0:1783969381.235567:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099282304:0@lo:400:kworker.0 00000100:00100000:0.0:1783969381.235777:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099281152 00000100:00100000:0.0:1783969381.235783:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099281152 00000100:00100000:0.0:1783969381.235827:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1783969381.235835:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099281152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969381.236295:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099281152:12345-0@lo:400:kworker.0 Request processed in 460us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969381.236303:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1783969381.236341:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969381.236353:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099282816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969381.236428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969381.238920:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099282944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969381.238991:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969381.244832:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099282816 00000100:00100000:3.0:1783969381.244848:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099282816 00000100:00100000:3.0:1783969381.244905:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099282944 00000100:00100000:3.0:1783969381.244908:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099282944 00000100:00100000:3.0:1783969381.244923:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783969381.244932:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099282816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783969381.244964:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783969381.245043:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099282816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (8614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969381.245049:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783969381.245065:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783969381.245070:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099282944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969381.245081:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783969381.245108:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099282944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (6118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969381.245113:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783969381.245514:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099281152:0@lo:400:kworker.0 00000100:00100000:0.0:1783969381.245629:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099282816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969381.245674:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099282944:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1783969381.308176:0:14927:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:02:58 (1783969378) 00000100:00100000:2.0:1783969381.744728:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099283072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969381.744802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969381.745778:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099283072 00000100:00100000:1.0:1783969381.745790:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099283072 00000100:00100000:1.0:1783969381.745927:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783969381.745938:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099283072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969381.745974:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969381.746034:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099283072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969381.746042:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783969381.746246:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099283072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969381.750186:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099283200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969381.750281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969381.750999:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099283200 00000100:00100000:1.0:1783969381.751009:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099283200 00000100:00100000:1.0:1783969381.751071:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783969381.751079:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099283200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969381.751102:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783969381.751209:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099283200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969381.751232:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783969381.751610:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099283200:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783969382.195738:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969383.179064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969383.180763:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969383.181033:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074064896 00000100:00100000:1.0:1783969383.181045:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074064896 00000100:00100000:1.0:1783969383.181137:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 394 00000100:00100000:1.0:1783969383.181149:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+18:2391:x1870627074064896:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969383.181223:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+18:2391:x1870627074064896:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 77us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969383.181231:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 394 00000100:00080000:2.0:1783969383.181850:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969383.182064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074064768 00000100:00100000:0.0:1783969383.182070:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074064768 00000100:00100000:0.0:1783969383.182127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 409 00000100:00100000:0.0:1783969383.182135:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074064768:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969383.182219:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2391:x1870627074064768:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 85us (3164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969383.182227:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 409 00000100:00100000:2.0:1783969383.184420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969383.184459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969383.184481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969383.184512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969383.184537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969383.184560:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074065280 00000100:00100000:2.0:1783969383.184576:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074065280 00000100:00100000:2.0:1783969383.184623:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074065152 00000100:00100000:2.0:1783969383.184626:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074065152 00000100:00100000:2.0:1783969383.184661:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:2.0:1783969383.184670:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074065280:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969383.184731:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2391:x1870627074065280:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 62us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969383.184738:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:2.0:1783969383.184755:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:2.0:1783969383.184761:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074065152:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969383.184785:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074065152:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969383.184790:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00080000:2.0:1783969383.184811:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969383.184815:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969383.184936:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074065024 00000100:00100000:1.0:1783969383.184941:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074065024 00000100:00100000:1.0:1783969383.184984:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074065536 00000100:00100000:1.0:1783969383.184987:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074065536 00000100:00100000:1.0:1783969383.185003:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074065408 00000100:00100000:1.0:1783969383.185006:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074065408 00000100:00100000:1.0:1783969383.185025:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 395 00000100:00100000:1.0:1783969383.185032:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074065024:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969383.185062:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2391:x1870627074065024:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 31us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969383.185068:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 395 00000100:00100000:1.0:1783969383.185098:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 396 00000100:00100000:1.0:1783969383.185106:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074065536:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969383.185130:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2391:x1870627074065536:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969383.185136:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 396 00000100:00100000:1.0:1783969383.185156:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 397 00000100:00100000:1.0:1783969383.185163:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2391:x1870627074065408:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969383.185190:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2391:x1870627074065408:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969383.185196:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 397 00000100:00080000:2.0:1783969383.186336:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969383.186343:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783969383.216818:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969384.241043:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969385.264864:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969385.332078:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099283328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969385.332158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969385.332978:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099283328 00000100:00100000:1.0:1783969385.332989:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099283328 00000100:00100000:1.0:1783969385.333051:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783969385.333063:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099283328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969385.333108:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783969385.333185:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099283328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969385.333192:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783969385.333571:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099283328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969385.841490:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969385.841530:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099283456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969385.841934:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969385.842468:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099283456 00000100:00100000:1.0:1783969385.842480:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099283456 00000100:00100000:1.0:1783969385.842550:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783969385.842563:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099283456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969385.842631:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783969385.842762:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099283456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 201us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969385.842772:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1783969385.842994:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099283456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969385.922755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969385.923101:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074065792 00000100:00100000:0.0:1783969385.923136:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074065792 00000100:00100000:0.0:1783969385.923244:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:0.0:1783969385.923267:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+18:13180:x1870627074065792:12345-192.168.201.34@tcp:35:umount.0 00000100:00080000:2.0:1783969385.923657:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969385.924166:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+19:13180:x1870627074065792:12345-192.168.201.34@tcp:35:umount.0 Request processed in 898us (1420us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1783969385.924180:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:3.0:1783969385.932118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969385.932363:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074066048 00000100:00100000:1.0:1783969385.932374:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074066048 00000100:00100000:1.0:1783969385.932744:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:1.0:1783969385.932758:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+19:13180:x1870627074066048:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:1.0:1783969385.933232:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+20:13180:x1870627074066048:12345-192.168.201.34@tcp:35:umount.0 Request processed in 475us (1140us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1783969385.933243:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:2.0:1783969385.940202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969385.943709:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074066304 00000100:00100000:0.0:1783969385.943813:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074066304 00000100:00100000:0.0:1783969385.943888:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:0.0:1783969385.943900:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+20:13180:x1870627074066304:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:0.0:1783969385.950832:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84ea2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+21:13180:x1870627074066304:12345-192.168.201.34@tcp:35:umount.0 Request processed in 6916us (10635us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1783969385.950852:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:0.0:1783969385.961574:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969385.961742:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074066560 00000100:00100000:3.0:1783969385.961756:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074066560 00000100:00100000:3.0:1783969385.961822:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:3.0:1783969385.961835:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+21:13180:x1870627074066560:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:3.0:1783969385.962308:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+22:13180:x1870627074066560:12345-192.168.201.34@tcp:35:umount.0 Request processed in 474us (747us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1783969385.962319:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:3.0:1783969385.967561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969385.967641:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074067200 00000100:00100000:3.0:1783969385.967651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969385.967656:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074067200 00000100:00100000:3.0:1783969385.967703:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969385.967758:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074067072 00000100:00100000:2.0:1783969385.967763:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074067072 00000100:00100000:3.0:1783969385.967769:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074067328 00000100:00100000:3.0:1783969385.967775:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074067328 00000100:00100000:2.0:1783969385.967789:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1783969385.967804:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+15:2393:x1870627074067200:12345-192.168.201.34@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783969385.967810:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1783969385.967822:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+15:2393:x1870627074067072:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969385.967832:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969385.967833:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969385.967871:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad8400/0xea31253a47cb9b28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303713 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969385.967871:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad9800/0xea31253a47cb9aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563036d4 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969385.967926:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969385.967927:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969385.975754:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+13:2393:x1870627074067200:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 7935us (8193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969385.975774:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1783969385.975832:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1783969385.975845:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:2393:x1870627074067328:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969385.975868:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969385.975899:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601200/0xea31253a47cb9db3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037ec expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969385.975920:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969385.978155:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:2393:x1870627074067328:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 2294us (10430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969385.978175:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:3.0:1783969385.979016:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2393:x1870627074067072:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 11189us (11357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969385.979029:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1783969385.979881:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969385.981935:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074066944 00000100:00100000:2.0:1783969385.982119:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074066944 00000100:00100000:2.0:1783969385.982294:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:2.0:1783969385.982307:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+7:2390:x1870627074066944:12345-192.168.201.34@tcp:9:umount.0 00000020:00000080:2.0:1783969385.982626:0:14243:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cba102 00000020:00010000:2.0:1783969385.982636:0:14243:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93e983d1c800: total 0 00000100:00080000:2.0:1783969385.982642:0:14243:0:(import.c:65:import_set_state_nolock()) ffff93e983d1d000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1783969385.982653:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:2.0:1783969385.982703:0:14243:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:1.0:1783969385.982724:0:8454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93e983d1c800: total 0 00010000:00010000:1.0:1783969385.982785:0:8454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93e983d1c800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1783969385.982857:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004472757e/0xea31253a47cbab90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bb9 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969385.982894:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015280cca/0xea31253a47cba4ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039d6 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969385.982908:0:8454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93e983d1c800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1783969385.982919:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969385.982921:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969385.982923:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969385.982995:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c481ab09-d97e-4adb-b42e-68f98b038d20+2:2390:x1870627074066944:12345-192.168.201.34@tcp:9:umount.0 Request processed in 690us (3118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969385.983006:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:1.0:1783969385.990052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969385.990106:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074067456 00000100:00100000:2.0:1783969385.990119:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074067456 00000100:00100000:0.0:1783969385.991172:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1783969385.991190:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2390:x1870627074067456:12345-192.168.201.34@tcp:9:umount.0 00000020:00000080:0.0:1783969385.991247:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cba569 00000100:00080000:0.0:1783969385.991261:0:8437:0:(import.c:65:import_set_state_nolock()) ffff93e983e50000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783969385.991350:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:1.0:1783969385.991357:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969385.991643:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c481ab09-d97e-4adb-b42e-68f98b038d20+2:2390:x1870627074067456:12345-192.168.201.34@tcp:9:umount.0 Request processed in 457us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969385.991652:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00080000:3.0:1783969385.992157:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969386.002155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969386.002697:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074068480 00000100:00100000:2.0:1783969386.002710:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074068480 00000100:00100000:2.0:1783969386.002793:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 258 00000100:00100000:2.0:1783969386.002808:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+22:2390:x1870627074068480:12345-192.168.201.34@tcp:39:umount.0 00000020:00000080:2.0:1783969386.002853:0:7749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9ab1 00000020:00010000:2.0:1783969386.002878:0:7749:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93e9835e8000: total 0 00000100:00080000:2.0:1783969386.002884:0:7749:0:(import.c:65:import_set_state_nolock()) ffff93e9835ee000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783969386.002927:0:7749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1783969386.003157:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c481ab09-d97e-4adb-b42e-68f98b038d20+21:2390:x1870627074068480:12345-192.168.201.34@tcp:39:umount.0 Request processed in 353us (1017us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1783969386.003167:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 258 00000020:00010000:3.0:1783969386.004827:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93e9835e8000: total 0 00010000:00010000:3.0:1783969386.004919:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93e9835e8000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783969386.004967:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:3.0:1783969386.004972:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783969386.004986:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2176a00/0xea31253a47cba4a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039cf expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005252:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969386.005257:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969386.005262:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daf400/0xea31253a47cba15d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563038ef expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005280:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ea911e6900) 00010000:00010000:2.0:1783969386.005283:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969386.005287:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796e00/0xea31253a47cb9e07 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303801 expref: 18 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005309:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:2.0:1783969386.005311:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969386.005315:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7796c00/0xea31253a47cba47b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039c1 expref: 17 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005574:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:2.0:1783969386.005608:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969386.005620:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7400/0xea31253a47cbaa71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303b6c expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005655:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969386.005658:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783969386.005663:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea9b600800/0xea31253a47cba53f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039f9 expref: 15 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005676:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:2.0:1783969386.005678:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969386.005682:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6400/0xea31253a47cbab51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ba4 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005693:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93ea911e6200) 00010000:00010000:2.0:1783969386.005695:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969386.005699:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdec00/0xea31253a47cba39b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303989 expref: 13 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005718:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ea911e6500) 00010000:00010000:2.0:1783969386.005721:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969386.005724:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eab7797800/0xea31253a47cb9deb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037fa expref: 12 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005738:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253200) 00010000:00010000:2.0:1783969386.005741:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969386.005745:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93eac2177600/0xea31253a47cba523 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563039f2 expref: 11 pid: 9027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005786:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93ea92d42000) 00010000:00010000:2.0:1783969386.005789:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783969386.005793:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cde600/0xea31253a47cbab7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bb2 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005808:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93ea911e6800) 00010000:00010000:2.0:1783969386.005811:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783969386.005815:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea89cdf000/0xea31253a47cb9e62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303816 expref: 9 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005971:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93e982170c00) 00010000:00010000:2.0:1783969386.005974:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969386.005978:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83daec00/0xea31253a47cba833 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ad2 expref: 8 pid: 7749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969386.005994:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93e9835e8000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1783969386.006031:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969386.006033:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969386.006036:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969386.019448:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969386.021448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074068608 00000100:00100000:2.0:1783969386.021464:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074068608 00000100:00100000:2.0:1783969386.021550:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 259 00000100:00100000:2.0:1783969386.021566:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+5:2390:x1870627074068608:12345-192.168.201.34@tcp:39:umount.0 00000100:00080000:3.0:1783969386.021583:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1783969386.021601:0:6521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9ab8 00000100:00080000:2.0:1783969386.021622:0:6521:0:(import.c:65:import_set_state_nolock()) ffff93e9835e9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783969386.021694:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1783969386.021745:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969386.021913:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c481ab09-d97e-4adb-b42e-68f98b038d20+3:2390:x1870627074068608:12345-192.168.201.34@tcp:39:umount.0 Request processed in 352us (2535us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783969386.021923:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 259 00010000:00010000:1.0:1783969386.289673:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969386.352762:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099283840:0@lo:400:kworker.0 00000100:00100000:1.0:1783969386.352848:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969386.352912:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099284352:0@lo:400:kworker.0 00000100:00100000:1.0:1783969386.352937:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969386.352960:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099284864:0@lo:400:kworker.0 00000100:00100000:1.0:1783969386.352999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969386.353024:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783969386.353030:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099283712:0@lo:400:kworker.0 00000100:00100000:1.0:1783969386.353050:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969386.353064:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099284224:0@lo:400:kworker.0 00000100:00100000:1.0:1783969386.353083:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969386.353103:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099284736:0@lo:400:kworker.0 00000100:00100000:1.0:1783969386.353122:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969386.353153:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099284352 00000100:00100000:1.0:1783969386.353160:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099284352 00000100:00100000:1.0:1783969386.353211:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099284864 00000100:00100000:1.0:1783969386.353214:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099284864 00000100:00100000:1.0:1783969386.353230:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099283712 00000100:00100000:1.0:1783969386.353233:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099283712 00000100:00100000:1.0:1783969386.353247:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099284224 00000100:00100000:1.0:1783969386.353250:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099284224 00000100:00100000:1.0:1783969386.353270:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099284736 00000100:00100000:1.0:1783969386.353273:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099284736 00000100:00100000:1.0:1783969386.353290:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1783969386.353298:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099284352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969386.353369:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099284352:12345-0@lo:400:kworker.0 Request processed in 72us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969386.353378:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1783969386.353436:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1783969386.353443:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099284864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969386.353479:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099284864:12345-0@lo:400:kworker.0 Request processed in 36us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969386.353496:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1783969386.353521:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099283712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.353566:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099283968:0@lo:400:kworker.0 00000100:00100000:3.0:1783969386.353705:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099285248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969386.353738:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1783969386.353768:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1783969386.353776:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099284224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.356490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969386.356541:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099284480:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.356581:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969386.356610:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099284992:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.356629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969386.356656:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1783969386.356664:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099283584:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.356690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969386.356710:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099284096:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.356732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969386.356749:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099284608:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.356768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969386.356784:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099285120:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.356803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969386.356854:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099284480 00000100:00100000:2.0:1783969386.356861:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099284480 00000100:00100000:2.0:1783969386.356920:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099284992 00000100:00100000:2.0:1783969386.356923:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099284992 00000100:00100000:2.0:1783969386.356937:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099284608 00000100:00100000:2.0:1783969386.356939:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099284608 00000100:00100000:2.0:1783969386.356973:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099285120 00000100:00100000:2.0:1783969386.356977:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099285120 00000100:00100000:2.0:1783969386.356993:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783969386.357015:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099284480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357082:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099284480:12345-0@lo:400:kworker.0 Request processed in 55us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.357089:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783969386.357108:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783969386.357114:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099284992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357143:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099284992:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.357149:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783969386.357161:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783969386.357166:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099284608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357191:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099284608:12345-0@lo:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.357197:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783969386.357206:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783969386.357210:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099285120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357232:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099285120:12345-0@lo:400:kworker.0 Request processed in 21us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.357237:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783969386.357259:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099283584 00000100:00100000:2.0:1783969386.357263:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099283584 00000100:00100000:2.0:1783969386.357290:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1783969386.357296:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099283584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357322:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099283584:12345-0@lo:400:kworker.0 Request processed in 27us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.357348:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1783969386.357402:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099283840 00000100:00100000:2.0:1783969386.357406:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099283840 00000100:00100000:2.0:1783969386.357423:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099284096 00000100:00100000:2.0:1783969386.357425:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099284096 00000100:00100000:2.0:1783969386.357436:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1783969386.357441:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099283840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357474:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099283840:12345-0@lo:400:kworker.0 Request processed in 32us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.357480:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1783969386.357490:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783969386.357495:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099284096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357518:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099284096:12345-0@lo:400:kworker.0 Request processed in 23us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.357523:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783969386.357558:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099283584:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357572:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099284096:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357581:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099284608:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357589:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099285120:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357598:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099284480:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357606:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099284992:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357637:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099283968 00000100:00100000:2.0:1783969386.357640:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099283968 00000100:00100000:2.0:1783969386.357670:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1783969386.357676:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099284736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357708:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099284736:12345-0@lo:400:kworker.0 Request processed in 32us (4585us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.357713:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1783969386.357727:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1783969386.357732:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099283968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.357760:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099283968:12345-0@lo:400:kworker.0 Request processed in 27us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.357766:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1783969386.357793:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099283968:0@lo:400:kworker.0 00000100:00080000:2.0:1783969386.357830:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969386.357835:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969386.357838:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969386.357841:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969386.357954:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099285376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969386.357985:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969386.358025:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099284736:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.358035:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099283840:0@lo:400:kworker.0 00010000:00080000:2.0:1783969386.358049:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983fc4700 x1870627099284352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969386.358059:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099284352:0@lo:400:kworker.0 00010000:00080000:2.0:1783969386.358070:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea867b3100 x1870627099284864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969386.358091:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099284864:0@lo:400:kworker.0 00000100:00100000:2.0:1783969386.358184:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099285376 00000100:00100000:2.0:1783969386.358188:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099285376 00000100:00100000:2.0:1783969386.358212:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783969386.358217:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099285376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783969386.358239:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783969386.358274:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099285376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.358280:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783969386.358306:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099285376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969386.361028:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099283712:12345-0@lo:400:kworker.0 Request processed in 7499us (7957us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969386.361053:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1783969386.361911:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099283712:0@lo:400:kworker.0 00000100:00100000:3.0:1783969386.364349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969386.365447:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099285248 00000100:00100000:2.0:1783969386.365463:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099285248 00000100:00100000:2.0:1783969386.365552:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783969386.365564:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099285248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969386.365604:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783969386.365698:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099285248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.365706:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783969386.365941:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099285248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969386.370127:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099284224:12345-0@lo:400:kworker.0 Request processed in 16340us (17030us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969386.370144:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1783969386.370258:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099284224:0@lo:400:kworker.0 00000040:00080000:0.0:1783969386.800927:0:13807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969386.800942:0:13807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969386.801089:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1783969386.801099:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969386.864856:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099285504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783969386.864962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969386.865059:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969386.865068:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099285632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969386.865097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969386.865210:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099285504 00000100:00100000:1.0:1783969386.865222:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099285504 00000100:00100000:1.0:1783969386.865292:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099285632 00000100:00100000:1.0:1783969386.865297:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099285632 00000100:00100000:1.0:1783969386.865329:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783969386.865340:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099285504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969386.865417:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969386.865503:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783969386.865515:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099285504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.865525:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099285632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969386.865527:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00002000:00000024:2.0:1783969386.865558:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969386.865631:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099285632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969386.865640:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783969386.865773:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099285632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969386.865791:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099285504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783969387.312754:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783969387.313723:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783969388.299174:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969388.299232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969388.299271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969388.299516:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074068992 00000100:00100000:3.0:1783969388.299529:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074068992 00000100:00100000:1.0:1783969388.299593:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074068736 00000100:00100000:1.0:1783969388.299598:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074068736 00000100:00100000:3.0:1783969388.299619:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074068864 00000100:00100000:3.0:1783969388.299621:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074068864 00000100:00100000:1.0:1783969388.299632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 411 00000100:00100000:3.0:1783969388.299642:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 404 00000100:00100000:1.0:1783969388.299643:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627074068736:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969388.299648:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074068992:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969388.299734:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627074068736:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 92us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969388.299742:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 411 00000100:00100000:2.0:1783969388.299768:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 405 00000100:00100000:2.0:1783969388.299777:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2392:x1870627074068864:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:0.0:1783969388.299858:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969388.299863:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969388.305022:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2392:x1870627074068992:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 5354us (5769us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969388.305044:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 404 00000100:00100000:2.0:1783969388.308673:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2392:x1870627074068864:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 8874us (9377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969388.308698:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 405 00010000:00010000:1.0:1783969388.337234:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969388.997272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969388.997372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969388.997505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969388.998235:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969388.998336:0:13769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074069632 00000100:00100000:1.0:1783969388.998351:0:13769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074069632 00000100:00100000:1.0:1783969388.998464:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 260 00000100:00100000:1.0:1783969388.998481:0:13769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+6:2390:x1870627074069632:12345-192.168.201.34@tcp:39:umount.0 00000020:00000080:1.0:1783969388.998545:0:13769:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9bc9 00000020:00010000:1.0:1783969388.998560:0:13769:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93e982780000: total 0 00000100:00080000:1.0:1783969388.998567:0:13769:0:(import.c:65:import_set_state_nolock()) ffff93e982785000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783969388.998602:0:13769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1783969388.998879:0:13769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2390:x1870627074069632:12345-192.168.201.34@tcp:39:umount.0 Request processed in 398us (645us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1783969388.998893:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 260 00000020:00010000:1.0:1783969388.999098:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93e982780000: total 0 00010000:00010000:1.0:1783969388.999106:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969388.999209:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93e982780000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783969388.999300:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93e982253200) 00010000:00010000:1.0:1783969388.999308:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969388.999327:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea83dae400/0xea31253a47cbab9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bc0 expref: 4 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969388.999372:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93e982780000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783969388.999465:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969388.999470:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969388.999473:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969389.013829:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074069120 00000100:00100000:2.0:1783969389.013852:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074069120 00000100:00100000:2.0:1783969389.013967:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074069248 00000100:00100000:2.0:1783969389.013971:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074069248 00000100:00100000:2.0:1783969389.013987:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074069504 00000100:00100000:2.0:1783969389.013990:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074069504 00000100:00100000:2.0:1783969389.014019:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1783969389.014030:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab2119450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+12:2391:x1870627074069120:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969389.014053:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969389.014079:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad9000/0xea31253a47cb9bb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303728 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969389.014103:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969389.014210:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab2119450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+11:2391:x1870627074069120:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 181us (16956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969389.014219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1783969389.014302:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:2.0:1783969389.014310:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+10:2392:x1870627074069248:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969389.014341:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969389.014351:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad8a00/0xea31253a47cb9bbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303759 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969389.014528:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969389.014577:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+9:2392:x1870627074069248:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 262us (17203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969389.014589:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:2.0:1783969389.014614:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:2.0:1783969389.014626:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+8:2393:x1870627074069504:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969389.014638:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969389.014655:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601a00/0xea31253a47cb9d90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d3563037e5 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969389.014668:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969389.014697:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+7:2393:x1870627074069504:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 73us (17193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969389.014707:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:1.0:1783969389.017122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969389.017713:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074069760 00000100:00100000:3.0:1783969389.017727:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074069760 00000100:00100000:3.0:1783969389.017919:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 261 00000100:00100000:3.0:1783969389.017931:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+5:2390:x1870627074069760:12345-192.168.201.34@tcp:39:umount.0 00000020:00000080:3.0:1783969389.017984:0:9027:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9bd0 00000100:00080000:3.0:1783969389.017996:0:9027:0:(import.c:65:import_set_state_nolock()) ffff93e982787800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783969389.018022:0:9027:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1783969389.018023:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969389.020058:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e4d5d10-19f9-4209-aea3-d3eeb3dcf898+3:2390:x1870627074069760:12345-192.168.201.34@tcp:39:umount.0 Request processed in 2116us (2933us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783969389.020073:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 261 00000100:00100000:1.0:1783969389.074569:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969389.074800:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074070016 00000100:00100000:2.0:1783969389.074814:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074070016 00000100:00100000:2.0:1783969389.074893:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 412 00000100:00100000:2.0:1783969389.074906:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+7:2390:x1870627074070016:12345-192.168.201.34@tcp:251:umount.0 00000020:00000080:2.0:1783969389.075107:0:6514:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9a8e 00000020:00010000:2.0:1783969389.075117:0:6514:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93eab72a2800: total 0 00000100:00080000:2.0:1783969389.075124:0:6514:0:(import.c:65:import_set_state_nolock()) ffff93eab72a0000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783969389.075301:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf66dfa7-835a-4dd9-abc8-2599d697b6ad+3:2390:x1870627074070016:12345-192.168.201.34@tcp:251:umount.0 Request processed in 395us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969389.075312:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 412 00000020:00010000:1.0:1783969389.075479:0:8454:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93eab72a2800: total 0 00010000:00010000:1.0:1783969389.075573:0:8454:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93eab72a2800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783969389.075618:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cde800/0xea31253a47cb9b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d35630371a expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969389.075634:0:8454:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93eab72a2800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783969389.075645:0:8454:0:(genops.c:906:class_export_put()) final put ffff93eab72a2800/bf66dfa7-835a-4dd9-abc8-2599d697b6ad 00010000:00010000:1.0:1783969389.075657:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969389.075659:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969389.075661:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783969389.081320:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab72a2800/bf66dfa7-835a-4dd9-abc8-2599d697b6ad for MGS 00000020:00000080:0.0:1783969389.081965:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab72a0000 for MGS 00010000:00010000:2.0:1783969389.366003:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969390.384495:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969390.466054:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969390.466081:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099285760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969390.466155:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969390.466216:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099285760 00000100:00100000:2.0:1783969390.466223:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099285760 00000100:00100000:2.0:1783969390.466290:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1783969390.466300:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099285760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783969390.466334:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783969390.467542:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099285760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969390.469819:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099285760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3511us (3654us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969390.469835:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1783969390.960777:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099285888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969390.960871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969390.961029:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099285888 00000100:00100000:2.0:1783969390.961038:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099285888 00000100:00100000:2.0:1783969390.961096:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1783969390.961105:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099285888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969390.961149:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783969390.961210:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099285888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969390.961218:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783969390.961535:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099285888:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783969391.408592:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969391.472485:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969391.472509:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099286016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969391.472587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.472660:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099286016 00000100:00100000:2.0:1783969391.472669:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099286016 00000100:00100000:2.0:1783969391.472728:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783969391.472737:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099286016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783969391.472781:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783969391.472832:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099286016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.472840:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1783969391.472865:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969391.472911:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099286016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969391.473285:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969391.473296:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099286144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969391.473345:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969391.473373:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099286144 00000100:00100000:0.0:1783969391.473397:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099286144 00000100:00100000:0.0:1783969391.473429:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783969391.473436:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099286144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969391.473449:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783969391.473483:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099286144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969391.473501:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1783969391.473516:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969391.473537:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099286144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969391.479826:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969391.479853:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099286272:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.479949:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.480014:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099286400:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480044:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.480074:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099286400 00000100:00100000:2.0:1783969391.480082:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099286400 00000100:00100000:2.0:1783969391.480130:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1783969391.480138:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099286400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480189:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099286400:12345-0@lo:400:kworker.0 Request processed in 51us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.480198:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1783969391.480258:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099286400:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480299:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969391.480308:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099286528:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480351:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.480377:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099286528 00000100:00100000:2.0:1783969391.480414:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099286528 00000100:00100000:2.0:1783969391.480439:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1783969391.480445:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099286528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480500:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099286528:12345-0@lo:400:kworker.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.480508:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1783969391.480533:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099286528:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480564:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099286656:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.480622:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969391.480628:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099286784:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480651:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.480687:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099286912:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480709:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.480741:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969391.480747:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099287040:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480769:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.480793:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099287040 00000100:00100000:2.0:1783969391.480796:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099287040 00000100:00100000:2.0:1783969391.480832:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783969391.480839:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099287040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480875:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099287040:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.480882:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783969391.480909:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099287040:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480937:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099287168:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.480958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.480991:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099287168 00000100:00100000:2.0:1783969391.480995:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099287168 00000100:00100000:2.0:1783969391.481018:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783969391.481024:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099287168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481056:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099287168:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.481062:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783969391.481088:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099287168:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481114:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969391.481121:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099287296:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481144:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.481169:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099286656 00000100:00100000:2.0:1783969391.481173:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099286656 00000100:00100000:2.0:1783969391.481195:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099286784 00000100:00100000:2.0:1783969391.481198:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099286784 00000100:00100000:2.0:1783969391.481213:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099286912 00000100:00100000:2.0:1783969391.481216:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099286912 00000100:00100000:2.0:1783969391.481228:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099287296 00000100:00100000:2.0:1783969391.481230:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099287296 00000100:00100000:2.0:1783969391.481256:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1783969391.481263:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099286656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481296:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099286656:12345-0@lo:400:kworker.0 Request processed in 33us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.481303:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1783969391.481315:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1783969391.481321:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099286784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481351:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099286784:12345-0@lo:400:kworker.0 Request processed in 30us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.481367:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1783969391.481417:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1783969391.481423:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099286912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481452:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099286912:12345-0@lo:400:kworker.0 Request processed in 30us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.481458:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1783969391.481470:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1783969391.481476:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea8896aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099287296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481499:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea8896aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1870627099287296:12345-0@lo:400:kworker.0 Request processed in 24us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.481505:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1783969391.481533:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1870627099287296:0@lo:400:kworker.0 00010000:00080000:2.0:1783969391.481545:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea88968700 x1870627099286912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969391.481556:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099286912:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481566:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099286784:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481589:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099286656:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481621:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099287424:0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481643:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.481665:0:9027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099287424 00000100:00100000:2.0:1783969391.481669:0:9027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099287424 00000100:00100000:2.0:1783969391.481692:0:9027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1783969391.481698:0:9027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099287424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969391.481735:0:9027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099287424:12345-0@lo:400:kworker.0 Request processed in 36us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.481741:0:9027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00010000:00080000:2.0:1783969391.481764:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea88968700 x1870627099287424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969391.481773:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099287424:0@lo:400:kworker.0 00000100:00100000:0.0:1783969391.482018:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099286272 00000100:00100000:0.0:1783969391.482023:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099286272 00000100:00100000:0.0:1783969391.482062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1783969391.482070:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099286272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969391.482118:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac0dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099286272:12345-0@lo:400:kworker.0 Request processed in 49us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969391.482125:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00080000:0.0:1783969391.482157:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969391.482162:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969391.482165:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969391.482273:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099286272:0@lo:400:kworker.0 00000020:01000004:2.0:1783969391.622549:0:15123:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783969391.648552:0:15123:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783969391.648620:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.648636:0:15123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.648642:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.648649:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.648676:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783969391.648680:0:15123:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783969391.648702:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783969391.648706:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783969391.648711:0:15123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783969391.648734:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93ea8e8ec800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783969391.648809:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783969391.648811:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099287552:0@lo:39:umount.0 00010000:00010000:3.0:1783969391.648821:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969391.648827:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969391.648830:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969391.648838:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969391.648844:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969391.648849:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783969391.648852:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783969391.648854:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783969391.648877:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969391.648878:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969391.648883:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969391.648903:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969391.648909:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eab7797600/0xea31253a47cb9b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969391.648918:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969391.648920:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969391.648921:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969391.648931:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099287680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969391.648961:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969391.649023:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099287680 00000100:00100000:0.0:1783969391.649030:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099287680 00000100:00100000:2.0:1783969391.649046:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099287552 00000100:00100000:2.0:1783969391.649050:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099287552 00000100:00100000:2.0:1783969391.649088:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783969391.649089:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783969391.649097:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870627099287552:12345-0@lo:39:umount.0 00000100:00100000:0.0:1783969391.649097:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3646:x1870627099287680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969391.649108:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1783969391.649118:0:6521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb96a5 00010000:00010000:0.0:1783969391.649123:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796800/0xea31253a47cb9b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9b3d expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783969391.649125:0:6521:0:(import.c:65:import_set_state_nolock()) ffff93eab9285800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783969391.649135:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969391.649167:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:3646:x1870627099287680:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.649169:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1870627099287552:12345-0@lo:39:umount.0 Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.649175:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783969391.649175:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:2.0:1783969391.649185:0:6521:0:(genops.c:906:class_export_put()) final put ffff93eab9280800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1783969391.649201:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783969391.649217:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea8e8ec800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783969391.649232:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099287552:0@lo:39:umount.0 00000020:00000080:3.0:1783969391.649253:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9280800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783969391.649310:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab9285800 for lustre-MDT0000 00000100:00100000:3.0:1783969391.649331:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099287680:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1783969391.649402:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783969391.649405:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783969391.649409:0:15123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783969391.650264:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650276:0:15123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650282:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650288:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650307:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969391.650312:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650334:0:15123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650340:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650345:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650368:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783969391.650375:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650400:0:15123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.650406:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969391.650407:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.650412:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650413:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.650419:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601800 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969391.650423:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650426:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783969391.650431:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650434:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969391.650438:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969391.650439:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650445:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad9c00 already unused, calling callback (ffffffffc131dc20) 10000000:01000000:0.0:1783969391.650445:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783969391.650447:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:00010000:2.0:1783969391.650453:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650459:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969391.650464:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969391.650469:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969391.650469:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969391.650471:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783969391.650473:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783969391.650475:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969391.650485:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.650489:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650491:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969391.650495:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b601800/0xea31253a47cb9b4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.650506:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969391.650509:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650510:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650517:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad9c00/0xea31253a47cb9a48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9a4f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.650520:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969391.650523:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650525:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969391.650527:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969391.650529:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969391.650530:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969391.650535:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969391.650536:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:01000000:0.0:1783969391.650540:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783969391.650542:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783969391.650544:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1783969391.650546:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099287936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969391.650556:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.650561:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969391.650565:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.650571:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eab7796600/0xea31253a47cb9da5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.650580:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969391.650582:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969391.650584:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969391.650585:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969391.650608:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099288064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969391.650629:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969391.650674:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650682:0:15123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650689:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650695:0:15123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650708:0:15123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783969391.650711:0:15123:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1783969391.650714:0:15123:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1783969391.650739:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969391.650743:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650749:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600a00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969391.650752:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650759:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969391.650765:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969391.650771:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783969391.650773:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783969391.650779:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783969391.650794:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650800:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969391.650806:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650812:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b600a00/0xea31253a47cb9604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb960b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.650821:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969391.650823:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969391.650825:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783969391.650839:0:15123:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1783969391.650843:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1783969391.650846:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969391.650851:0:15123:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1783969391.650855:0:15123:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93eab725c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783969391.650860:0:15123:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93e981ac3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783969391.650865:0:15123:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93eab6101000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783969391.650869:0:15123:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff93eab6100800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1783969391.650876:0:15123:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff93e982780000 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 192.168.201.34@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783969391.650881:0:15123:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff93e9835e8000 c481ab09-d97e-4adb-b42e-68f98b038d20 192.168.201.34@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:2.0:1783969391.650886:0:15123:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff93eaa5b019c0) has exports, disconnecting them 00000020:00080000:2.0:1783969391.650890:0:15123:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93eab725c800), last request at 1783969391 00000020:00000080:2.0:1783969391.650895:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb99b5 00000100:00100000:0.0:1783969391.650895:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099287936 00000100:00100000:0.0:1783969391.650899:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099287936 00000100:00080000:2.0:1783969391.650907:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93eab725f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783969391.650930:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099288064 00000100:00100000:0.0:1783969391.650933:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099288064 00000020:00080000:2.0:1783969391.650953:0:15123:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93eab725c800): rc 0 00000020:00000080:2.0:1783969391.650956:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eab725c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783969391.650964:0:15123:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93e981ac3000), last request at 1783969391 00000100:00100000:0.0:1783969391.650966:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000020:00000080:2.0:1783969391.650967:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb988f 00000100:00080000:2.0:1783969391.650972:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93e981ac4000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783969391.650972:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+24:3649:x1870627099287936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969391.650981:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969391.650983:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:2.0:1783969391.650987:0:15123:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93e981ac3000): rc 0 00000020:00000080:2.0:1783969391.650989:0:15123:0:(genops.c:906:class_export_put()) final put ffff93e981ac3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1783969391.650992:0:15123:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93eab6101000), last request at 1783969129 00010000:00010000:0.0:1783969391.650994:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad9600/0xea31253a47cb9a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9a48 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783969391.650995:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb978c 00000100:00080000:2.0:1783969391.650998:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93eab6105800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783969391.651004:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969391.651005:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783969391.651009:0:15123:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93eab6101000): rc 0 00000020:00000080:2.0:1783969391.651011:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eab6101000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1783969391.651015:0:15123:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93eab6100800), last request at 1783969129 00000020:00000080:2.0:1783969391.651018:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb974d 00000100:00080000:2.0:1783969391.651021:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93eab610e800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783969391.651029:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969391.651034:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+23:3649:x1870627099287936:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (449us total) trans 0 rc 0/0 00000001:00000004:2.0:1783969391.651035:0:15123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:0.0:1783969391.651040:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783969391.651053:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783969391.651058:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:3649:x1870627099288064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969391.651077:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969391.651085:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601c00/0xea31253a47cb9dac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9da5 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969391.651093:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1783969391.651109:0:15123:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93eab6100800): rc 0 00000100:00100000:0.0:1783969391.651112:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3649:x1870627099288064:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (484us total) trans 0 rc 0/0 00000004:00000080:2.0:1783969391.651116:0:15123:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffafc3c7a3fae0 00000100:00100000:0.0:1783969391.651118:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1783969391.651134:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783969391.651137:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1783969391.651145:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099288064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969391.651153:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:3649:1870627099287936:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1783969391.651210:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab725c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783969391.651258:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e981ac3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783969391.651281:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab6101000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783969391.651306:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab725f000 for lustre-MDT0000 00000020:00000080:0.0:1783969391.651339:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e981ac4000 for lustre-MDT0000 00000020:00000080:0.0:1783969391.651342:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab6105800 for lustre-MDT0000 00010000:00010000:0.0:1783969391.651354:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783969391.651884:0:15123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783969391.651901:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93eab9fc7800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783969391.652020:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969391.652039:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea889e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099287808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969391.652077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969391.652079:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099288320:0@lo:39:umount.0 00000100:00100000:3.0:1783969391.652108:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969391.652108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969391.652114:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099288192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969391.652135:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969391.652137:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099288320 00000100:00100000:0.0:1783969391.652141:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099288320 00000100:00100000:3.0:1783969391.652162:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099287808 00000100:00100000:3.0:1783969391.652165:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099287808 00000100:00100000:0.0:1783969391.652171:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783969391.652178:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870627099288320:12345-0@lo:39:umount.0 00000100:00100000:3.0:1783969391.652188:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099288192 00000100:00100000:3.0:1783969391.652190:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099288192 00000020:00000080:0.0:1783969391.652199:0:6526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb97e7 00000100:00100000:3.0:1783969391.652201:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1783969391.652205:0:6526:0:(import.c:65:import_set_state_nolock()) ffff93eab610c000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783969391.652206:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+22:3647:x1870627099287808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969391.652214:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00000004:0.0:1783969391.652219:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1783969391.652227:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796a00/0xea31253a47cb9b52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9b4b expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969391.652238:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969391.652277:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+21:3647:x1870627099287808:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969391.652284:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969391.652299:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969391.652304:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab211a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+20:3647:x1870627099288192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969391.652311:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969391.652319:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eac2176c00/0xea31253a47cb960b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9604 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969391.652337:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969391.652354:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab211a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfed4274-bbe1-4392-be5b-cfbff577e88d+19:3647:x1870627099288192:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969391.652356:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3645:x1870627099288320:12345-0@lo:39:umount.0 Request processed in 179us (249us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783969391.652360:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969391.652362:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00010000:0.0:1783969391.652397:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783969391.652421:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9fc7800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783969391.652426:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099288192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969391.652427:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099288320:0@lo:39:umount.0 00000100:00100000:3.0:1783969391.652433:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea889e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099287808:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1783969391.653795:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783969391.653802:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1783969391.653863:0:15123:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783969391.653926:0:15123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783969391.653946:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93eab7259800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783969391.653967:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783969391.653970:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1783969391.653979:0:15123:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783969391.654004:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099288448:0@lo:9:umount.0 00000100:00080000:2.0:1783969391.654034:0:15123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783969391.654042:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93eab9f03000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783969391.654057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1783969391.654092:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff93eaa5b019c0) has no exports 00000100:00100000:0.0:1783969391.654169:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099288576:0@lo:9:umount.0 00000100:00100000:0.0:1783969391.654194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969391.654229:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099288448 00000100:00100000:0.0:1783969391.654235:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099288448 00000100:00100000:0.0:1783969391.654282:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099288576 00000100:00100000:0.0:1783969391.654285:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099288576 00000100:00100000:0.0:1783969391.654304:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783969391.654688:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870627099288448:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783969391.654712:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9937 00000100:00080000:0.0:1783969391.654720:0:8436:0:(import.c:65:import_set_state_nolock()) ffff93e981ac1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783969391.654757:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1783969391.656969:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3645:x1870627099288448:12345-0@lo:9:umount.0 Request processed in 2275us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969391.657013:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783969391.657224:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea889e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870627099288576:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783969391.657264:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9a87 00000100:00080000:3.0:1783969391.657275:0:8437:0:(import.c:65:import_set_state_nolock()) ffff93e983309000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783969391.657299:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1783969391.657318:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1783969391.659347:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea889e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3645:x1870627099288576:12345-0@lo:9:umount.0 Request processed in 2320us (5146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969391.659361:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000001:00100000:1.0:1783969391.660255:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783969391.660271:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:1.0:1783969391.660275:0:8432:0:(genops.c:906:class_export_put()) final put ffff93e983e52800/c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:1.0:1783969391.660305:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e983e52800/c481ab09-d97e-4adb-b42e-68f98b038d20 for lustre-OST0000 00000001:00100000:2.0:1783969391.660357:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783969391.660363:0:6500:0:(genops.c:906:class_export_put()) final put ffff93eab6100800/lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1783969391.660742:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000020:00000080:0.0:1783969391.660755:0:8436:0:(genops.c:906:class_export_put()) final put ffff93e981ac7800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783969391.661676:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000001:00080000:2.0:1783969391.661688:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:2.0:1783969391.661692:0:6500:0:(genops.c:906:class_export_put()) final put ffff93e982780000/2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000001:00100000:2.0:1783969391.661701:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000001:00080000:2.0:1783969391.661706:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1783969391.661715:0:6500:0:(genops.c:906:class_export_put()) final put ffff93e9835e8000/c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:1.0:1783969391.661994:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e983e50000 for lustre-OST0000 00000020:00000080:1.0:1783969391.662006:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab6100800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783969391.662043:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e982780000/2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 for lustre-MDT0000 00000020:00000080:1.0:1783969391.662070:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e9835e8000/c481ab09-d97e-4adb-b42e-68f98b038d20 for lustre-MDT0000 00000020:00000080:1.0:1783969391.662102:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab610e800 for lustre-MDT0000 00000020:00000080:1.0:1783969391.662107:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e982785000 for lustre-MDT0000 00000020:00000080:1.0:1783969391.662111:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e9835ee000 for lustre-MDT0000 00000100:00080000:0.0:1783969391.662752:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9f03000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783969391.662782:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783969391.662784:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783969391.662791:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099288576:0@lo:9:umount.0 00000100:00080000:0.0:1783969391.662809:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab7259800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783969391.662820:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783969391.662822:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783969391.662825:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099288448:0@lo:9:umount.0 00010000:00010000:0.0:1783969391.663492:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783969391.667146:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e981ac7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783969391.667232:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e981ac1000 for lustre-OST0000 00000001:00100000:1.0:1783969391.671916:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783969391.671931:0:9517:0:(genops.c:906:class_export_put()) final put ffff93e98330f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783969391.671956:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:1.0:1783969391.671959:0:9517:0:(genops.c:906:class_export_put()) final put ffff93e983d1c800/c481ab09-d97e-4adb-b42e-68f98b038d20 00000001:00100000:2.0:1783969391.672259:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783969391.672277:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1783969391.672284:0:7452:0:(genops.c:906:class_export_put()) final put ffff93eab932c800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783969391.672294:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000001:00080000:2.0:1783969391.672298:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1783969391.672300:0:7452:0:(genops.c:906:class_export_put()) final put ffff93e982781800/2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 00000001:00100000:2.0:1783969391.672304:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c481ab09-d97e-4adb-b42e-68f98b038d20 00000001:00080000:2.0:1783969391.672308:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1783969391.672309:0:7452:0:(genops.c:906:class_export_put()) final put ffff93e9835e8800/c481ab09-d97e-4adb-b42e-68f98b038d20 00000020:00000080:0.0:1783969391.672433:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e98330f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783969391.672482:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e983d1c800/c481ab09-d97e-4adb-b42e-68f98b038d20 for lustre-OST0001 00000020:00000080:0.0:1783969391.672503:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab932c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783969391.672536:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e982781800/2e4d5d10-19f9-4209-aea3-d3eeb3dcf898 for lustre-MDT0001 00000020:00000080:0.0:1783969391.672556:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e9835e8800/c481ab09-d97e-4adb-b42e-68f98b038d20 for lustre-MDT0001 00000020:00000080:0.0:1783969391.672579:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e983309000 for lustre-OST0001 00000020:00000080:0.0:1783969391.672584:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e983d1d000 for lustre-OST0001 00000020:00000080:0.0:1783969391.672590:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab610c000 for lustre-MDT0001 00000020:00000080:0.0:1783969391.672593:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e982787800 for lustre-MDT0001 00000020:00000080:0.0:1783969391.672597:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e9835e9000 for lustre-MDT0001 00000020:00080000:2.0:1783969391.674349:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff93eaa5b019c0) has no exports 00000020:00000080:2.0:1783969391.748783:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb965f 00000020:00000080:2.0:1783969391.748825:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eab90ca800/lustre-QMT0000_UUID 00000020:01000000:2.0:1783969391.748895:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783969391.752491:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969391.752507:0:15123:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783969391.752512:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff93eac0e7cd40) has no exports 00000020:00000080:2.0:1783969391.753007:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9658 00000020:00000080:2.0:1783969391.753016:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eab90ce800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783969391.753153:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab90ca800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783969391.757908:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab90ce800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783969391.758096:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783969391.758108:0:15123:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783969391.758175:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eaa01e9800/lustre-QMT0000_UUID 00000020:00000080:3.0:1783969391.758180:0:15123:0:(genops.c:865:class_export_destroy()) destroying export ffff93eaa01e9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783969391.758185:0:15123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1783969391.758372:0:15123:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93e9830abc60 - data ffff93e981c455e8/ffff93e983473c00 00000020:01000000:0.0:1783969391.760909:0:15123:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93ea9080b900 - data ffff93eaad047360/ffff93eab92b8000 00000001:00000004:1.0:1783969391.779737:0:15123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1783969391.863890:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783969391.863902:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1783969391.863924:0:15123:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93e98319c380 x1870627099288320/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783969401 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969391.863962:0:15123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783969391.866057:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783969391.866075:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1783969391.866099:0:15123:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783969391.866101:0:15123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783969391.869561:0:8838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783969391.869572:0:8838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1783969391.869594:0:8838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1783969391.882083:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783969391.882095:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1783969391.882129:0:15123:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783969391.882132:0:15123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783969391.887622:0:9983:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783969391.887632:0:9983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1783969391.887648:0:9983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1783969391.889021:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9627 00000020:00000080:0.0:1783969391.889031:0:15123:0:(genops.c:906:class_export_put()) final put ffff93ea8e8ea000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783969391.889086:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea8e8ea000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783969391.905128:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb963c 00000020:00000080:1.0:1783969391.905148:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eaabc0d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783969391.905181:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783969391.905187:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969391.905199:0:15123:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783969391.905203:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff93eaa5b03380) has no exports 00000020:00000080:0.0:1783969391.905290:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eaabc0d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1783969391.905533:0:15123:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783969391.905546:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9a72 00000020:00000080:1.0:1783969391.905552:0:15123:0:(genops.c:906:class_export_put()) final put ffff93e9835ef000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783969391.905566:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783969391.905571:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969391.905582:0:15123:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783969391.905586:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff93eab7558000) has no exports 00000020:00000080:0.0:1783969391.905589:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e9835ef000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783969391.905596:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9a6b 00000020:00000080:1.0:1783969391.905602:0:15123:0:(genops.c:906:class_export_put()) final put ffff93e982782800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783969391.905618:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e982782800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783969391.906306:0:15123:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783969391.906313:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783969391.910443:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1783969391.910469:0:15123:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783969391.910473:0:15123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783969391.910582:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969391.910605:0:15123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783969391.910617:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9930 00000020:00000080:1.0:1783969391.910630:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eabf76c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783969391.910639:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783969391.910646:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969391.910653:0:15123:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783969391.910658:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff93eab7160000) has no exports 00000020:00000080:1.0:1783969391.911588:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9929 00000020:00000080:1.0:1783969391.911598:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eab725d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783969391.912442:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab9f03000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783969391.912461:0:8:0:(genops.c:906:class_export_put()) final put ffff93e982784800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783969391.912464:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93e982784800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783969391.912482:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783969391.912583:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eabf76c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783969391.912589:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab725d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783969391.915291:0:15123:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783969391.915303:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783969391.915309:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1783969391.915320:0:15123:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783969391.915332:0:15123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783969391.915425:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969391.915444:0:15123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1783969391.915465:0:15123:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783969391.915475:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb97e0 00000020:00000080:1.0:1783969391.915487:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eab90c8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783969391.915495:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1783969391.915504:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969391.915510:0:15123:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783969391.915514:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff93eac0e7b380) has no exports 00000020:00000080:1.0:1783969391.915523:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb97d9 00000020:00000080:1.0:1783969391.915527:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eab9fc2000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783969391.916538:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab7259800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783969391.916558:0:8:0:(genops.c:906:class_export_put()) final put ffff93eab725f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783969391.916561:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab725f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783969391.916571:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783969391.916671:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab90c8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783969391.916680:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9fc2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783969391.918504:0:15123:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783969391.918515:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783969391.918522:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1783969391.918533:0:15123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783969391.918616:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969391.918635:0:15123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783969391.918686:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969391.918691:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab9fc7800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783969391.918691:0:15123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783969391.918699:0:15123:0:(genops.c:906:class_export_put()) final put ffff93ea8e8e9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783969391.918706:0:15123:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea8e8e9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1783969391.918728:0:8:0:(genops.c:906:class_export_put()) final put ffff93eab6101800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783969391.918728:0:15123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783969391.918737:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab6101800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1783969391.918747:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783969391.918943:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9643 00000020:00000080:0.0:1783969391.918954:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eaabc09000/lustre-MDD0000_UUID 00000020:01000000:0.0:1783969391.918970:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783969391.918975:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969391.918980:0:15123:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1783969391.918994:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eaabc09000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00080000:0.0:1783969391.918998:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff93eaa5b04d40) has no exports 00000020:00000080:0.0:1783969391.919030:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969391.919036:0:15123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783969391.919042:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eaabc08000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783969391.919044:0:15123:0:(genops.c:865:class_export_destroy()) destroying export ffff93eaabc08000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783969391.919057:0:15123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783969391.919093:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb964a 00000020:00000080:0.0:1783969391.919098:0:15123:0:(genops.c:906:class_export_put()) final put ffff93eaabc0f000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783969391.919118:0:15123:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ea912c9800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783969391.919122:0:15123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ea912c9800 3 00000020:01000004:0.0:1783969391.919126:0:15123:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ea912c9800 from lustre-MDT0000 00000020:00000080:0.0:1783969391.919149:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969391.919154:0:15123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783969391.919157:0:15123:0:(genops.c:906:class_export_put()) final put ffff93ea8e8eb800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783969391.919159:0:15123:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea8e8eb800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783969391.919168:0:15123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783969391.919197:0:15123:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783969391.919202:0:15123:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783969391.919207:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783969391.919211:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969391.919212:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eaabc0f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783969391.919215:0:15123:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783969391.919229:0:15123:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff93eaa5ae8000 bfed4274-bbe1-4392-be5b-cfbff577e88d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783969391.919235:0:15123:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff93ea84d7b380) has exports, disconnecting them 00000020:00080000:0.0:1783969391.919250:0:15123:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93eaa5ae8000), last request at 1783969108 00000020:00000080:0.0:1783969391.919274:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb95e8 00000020:00010000:0.0:1783969391.919279:0:15123:0:(genops.c:1942:obd_stale_export_put()) Put export ffff93eaa5ae8000: total 0 00000100:00080000:0.0:1783969391.919283:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93eaa5aea800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783969391.919304:0:15123:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93eaa5ae8000): rc 0 00000020:00080000:0.0:1783969391.919309:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff93ea84d7b380) has no exports 00000020:00010000:2.0:1783969391.919341:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff93eaa5ae8000: total 0 00010000:00010000:2.0:1783969391.919422:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff93eaa5ae8000, canceled 0 locks, left on hash table 13. 00000100:00100000:0.0:1783969391.919442:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff93ea91499c00:6514] 0 exiting: rc = 1 00010000:00010000:2.0:1783969391.919465:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797000/0xea31253a47cb9b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9afe expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919487:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797200/0xea31253a47cb9b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9b0c expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919501:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea813a0200/0xea31253a47cb9dc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9dba expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919517:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea813a0600/0xea31253a47cb9d9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9d97 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919538:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601e00/0xea31253a47cb96e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb96dd expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919566:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b600600/0xea31253a47cb9b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9b1a expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919584:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e981ad8600/0xea31253a47cb9b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9b59 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969391.919606:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff93ea865c0c00:6515] 1 exiting: rc = 0 00010000:00010000:2.0:1783969391.919671:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdf600/0xea31253a47cb9d89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9d82 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919702:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea813a0800/0xea31253a47cb96f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb96eb expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919713:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b601000/0xea31253a47cb9ae9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9ae2 expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919722:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7797400/0xea31253a47cb9af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9af0 expref: 4 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919731:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea9b600400/0xea31253a47cb9b36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9b2f expref: 3 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919741:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdea00/0xea31253a47cb9a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea31253a47cb9a02 expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969391.919751:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff93eaa5ae8000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1783969391.919767:0:6510:0:(genops.c:906:class_export_put()) final put ffff93eaa5ae8000/bfed4274-bbe1-4392-be5b-cfbff577e88d 00010000:00010000:2.0:1783969391.919795:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969391.919797:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969391.919800:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783969391.919850:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff93eaa5ae8000/bfed4274-bbe1-4392-be5b-cfbff577e88d for MGS 00000020:00000080:0.0:1783969391.919890:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eaa5aea800 for MGS 00000100:00100000:0.0:1783969391.920742:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93ea865c1000:6516] 2 exiting: rc = 0 00000100:00100000:2.0:1783969391.921003:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921019:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921025:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921031:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921037:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921043:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921048:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921055:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921200:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921205:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921225:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921232:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921302:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921311:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921319:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921324:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921330:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921336:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921344:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921350:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921357:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921363:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921369:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921374:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921406:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921415:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921421:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921427:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921433:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921439:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921444:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921451:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921457:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921462:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921468:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921474:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921480:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921485:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921490:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921495:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921502:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921508:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921513:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921519:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921524:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921539:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921544:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921549:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921554:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921559:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921564:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921569:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921575:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921580:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921585:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921591:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921597:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921617:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921624:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921630:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921636:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921641:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921647:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969391.921652:0:15123:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783969391.924972:0:15123:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93ea861b1600 - data ffff93eaad34baf8/ffff93e9824de800 00000020:01000000:2.0:1783969391.925269:0:15123:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93ea908cd2a0 - data ffff93eaad0b1d80/ffff93eaac72fc00 00000020:00000080:2.0:1783969391.925979:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb95cc 00000020:00000080:2.0:1783969391.925991:0:15123:0:(genops.c:906:class_export_put()) final put ffff93ea912ce000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783969391.926065:0:15123:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ea912c9800 from MGS, refs=2 00000020:01000004:2.0:1783969391.926070:0:15123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ea912c9800 2 00000020:01000004:2.0:1783969391.926073:0:15123:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ea912c9800 from MGS 00000020:00000080:2.0:1783969391.926095:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969391.926101:0:15123:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783969391.926104:0:15123:0:(genops.c:906:class_export_put()) final put ffff93ea912c9000/MGS 00000020:00000080:2.0:1783969391.926106:0:15123:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea912c9000/MGS for MGS 00000020:01000000:2.0:1783969391.926113:0:15123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783969391.926255:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783969391.926259:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969391.926265:0:15123:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783969391.926283:0:15123:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93ea8e8eb000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783969391.926288:0:15123:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff93eab9208000) has exports, disconnecting them 00000020:00080000:2.0:1783969391.926293:0:15123:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93ea8e8eb000), last request at 1783969109 00000020:00000080:2.0:1783969391.926298:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9697 00000020:00080000:2.0:1783969391.926309:0:15123:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ea8e8eb000): rc 0 00000020:00000080:2.0:1783969391.926313:0:15123:0:(genops.c:906:class_export_put()) final put ffff93ea8e8eb000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783969391.929589:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea912ce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783969391.931233:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea8e8eb000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783969391.935843:0:15123:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783969391.935852:0:15123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969391.935857:0:15123:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783969391.935864:0:15123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783969391.935895:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93ea8e8ec800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783969391.936047:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969391.936056:0:15123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783969391.936061:0:15123:0:(genops.c:906:class_export_put()) final put ffff93ea8e8ee800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783969391.936065:0:15123:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea8e8ee800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783969391.936071:0:15123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783969391.936162:0:15123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ea912c9800 1 00000020:00000080:0.0:1783969391.936168:0:15123:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb95be 00000020:00000080:0.0:1783969391.936174:0:15123:0:(genops.c:906:class_export_put()) final put ffff93ea912cd800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783969391.936182:0:15123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783969391.936190:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea912cd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783969391.936199:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969391.936203:0:15123:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783969391.936207:0:15123:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff93ea84d78000) has no exports 00000100:00100000:0.0:1783969392.018544:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099288704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969392.018636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969392.066803:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099288704 00000100:00100000:0.0:1783969392.066819:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099288704 00000100:00100000:0.0:1783969392.066879:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783969392.066889:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099288704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969392.066936:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783969392.067015:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099288704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (48378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969392.067022:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783969392.067087:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea88968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099288704:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1783969392.230246:0:15123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969392.230272:0:15123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783969392.230278:0:15123:0:(genops.c:906:class_export_put()) final put ffff93ea912cb000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783969392.230282:0:15123:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea912cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783969392.230289:0:15123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783969392.230557:0:15123:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93ea912ca000 00000020:02000400:0.0:1783969392.230617:0:15123:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783969392.448483:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969393.458817:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969394.480537:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969395.504659:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969395.569615:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969395.569649:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099288832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969395.569749:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969395.569834:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099288832 00000100:00100000:1.0:1783969395.569844:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099288832 00000100:00100000:1.0:1783969395.570593:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783969395.570606:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1870627099288832:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1783969395.570617:0:6526:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783969395.570685:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1870627099288832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (935us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783969395.570694:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:02020000:0.0:1783969395.570839:0:3649:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1783969395.581692:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783969395.581703:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93eab6104000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783969395.581709:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783969395.592884:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93eab6104000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783969395.592908:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 191 00000100:00080000:0.0:1783969395.592925:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93eab6104000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969395.593036:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabbff3480 x1870627099288960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969395.593304:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099288960:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783969395.593461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969395.594684:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099288960 00000100:00100000:0.0:1783969395.594697:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099288960 00000100:00100000:0.0:1783969395.594751:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1783969395.594762:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099288960:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1783969395.594808:0:6526:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783969395.594916:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099288960:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 154us (1454us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783969395.594925:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:1.0:1783969395.595154:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6104000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969395.595160:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783969395.595165:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099288960:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1783969396.528955:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969396.597337:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969396.597368:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099289088:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783969396.597442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969396.597450:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783969396.597456:0:8:0:(import.c:65:import_set_state_nolock()) ffff93eab6104000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969396.597465:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 457 00000100:00080000:3.0:1783969396.597501:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783969396.597511:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93eab6104000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969396.597526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969396.597547:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d21880 x1870627099289344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969396.597615:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099289600:0@lo:400:kworker.0 00000100:00100000:0.0:1783969396.597665:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969396.597715:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099290112:0@lo:400:kworker.0 00000100:00100000:0.0:1783969396.597744:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969396.597771:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969396.597791:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099289728:0@lo:400:kworker.0 00000100:00100000:0.0:1783969396.598194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969396.598283:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099289216:0@lo:400:kworker.0 00000400:00000100:0.0:1783969396.598306:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870627099289216 offset 0 length 224: 4 00000100:00100000:0.0:1783969396.598326:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099289856:0@lo:400:kworker.0 00000100:00100000:0.0:1783969396.598360:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969396.598417:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783969396.598428:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099289472:0@lo:400:kworker.0 00000100:00100000:0.0:1783969396.598456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969396.600604:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099289344:0@lo:38:kworker.0 00000100:00100000:1.0:1783969396.600698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969396.600806:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099289344 00000100:00100000:1.0:1783969396.600815:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099289344 00000100:00100000:1.0:1783969396.600864:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1783969396.600873:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099289344:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783969396.600900:0:6526:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783969396.600949:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099289344:12345-0@lo:38:kworker.0 Request processed in 75us (251us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783969396.600957:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:1.0:1783969396.601010:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6104000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969396.601015:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783969396.601019:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099289344:0@lo:38:kworker.0 00000100:00100000:0.0:1783969396.604110:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099289984:0@lo:400:kworker.0 00000100:00100000:0.0:1783969396.604188:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969396.604249:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099289600 00000100:00100000:2.0:1783969396.604258:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099289600 00000100:00100000:2.0:1783969396.604310:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099290112 00000100:00100000:2.0:1783969396.604312:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099290112 00000100:00100000:2.0:1783969396.604342:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099289728 00000100:00100000:2.0:1783969396.604345:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099289728 00000100:00100000:2.0:1783969396.604356:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099289472 00000100:00100000:2.0:1783969396.604359:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099289472 00000100:00100000:2.0:1783969396.604371:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1783969396.604395:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099290112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969396.604459:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099290112:12345-0@lo:400:kworker.0 Request processed in 79us (6716us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969396.604466:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1783969396.604487:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1783969396.604515:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099289728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969396.604545:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099289728:12345-0@lo:400:kworker.0 Request processed in 31us (6352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969396.604550:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1783969396.604563:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783969396.604574:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1870627099289600:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783969396.604581:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783969396.604607:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1870627099289600:12345-0@lo:400:kworker.0 Request processed in 32us (6943us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783969396.604613:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783969396.604627:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783969396.604630:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1870627099289472:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783969396.604635:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783969396.604656:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1870627099289472:12345-0@lo:400:kworker.0 Request processed in 24us (6199us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783969396.604661:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1783969396.604699:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783969396.604735:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93e983d20700 x1870627099289728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969396.604749:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099289728:0@lo:400:kworker.0 00010000:00080000:2.0:1783969396.604760:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93e983d22d80 x1870627099290112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969396.604768:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099290112:0@lo:400:kworker.0 00000100:00080000:2.0:1783969396.604788:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783969396.604793:0:3648:0:(import.c:65:import_set_state_nolock()) ffff93e9821a0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783969396.606745:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1783969396.614789:0:10104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099289088 00000100:00100000:1.0:1783969396.614809:0:10104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099289088 00000100:00100000:1.0:1783969396.614904:0:10104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783969396.614918:0:10104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea88968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099289088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969396.614963:0:10104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783969396.615069:0:10104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea88968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099289088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (17544us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969396.615078:0:10104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783969396.615279:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099289856 00000100:00100000:1.0:1783969396.615284:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099289856 00000100:00100000:1.0:1783969396.615320:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783969396.615327:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099289856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969396.615368:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099289856:12345-0@lo:400:kworker.0 Request processed in 41us (17007us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969396.615375:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1783969396.616883:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969396.616895:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969396.623715:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099289856:0@lo:400:kworker.0 00000100:00080000:0.0:1783969396.623753:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783969396.623758:0:3646:0:(import.c:65:import_set_state_nolock()) ffff93eab9ee2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783969396.623762:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783969396.623768:0:3646:0:(import.c:65:import_set_state_nolock()) ffff93eab9ee2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783969396.623772:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 191 00000100:00080000:0.0:1783969396.623970:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93eab9ee2000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969396.624011:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf745f80 x1870627099290240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969396.624040:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099289472:0@lo:400:kworker.0 00000100:00100000:0.0:1783969396.624120:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870627099290240:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783969396.624192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969396.624233:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099289984 00000100:00100000:0.0:1783969396.624240:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099289984 00000100:00100000:0.0:1783969396.624273:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099290240 00000100:00100000:0.0:1783969396.624276:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099290240 00000100:00100000:0.0:1783969396.624293:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783969396.624299:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1870627099289984:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783969396.624307:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783969396.624346:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1870627099289984:12345-0@lo:400:kworker.0 Request processed in 45us (20158us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783969396.624353:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783969396.624369:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783969396.624373:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099290240:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783969396.624438:0:6521:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783969396.624507:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099290240:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 131us (314us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783969396.624516:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1783969396.624556:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9ee2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783969396.624561:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783969396.624564:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870627099290240:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1783969396.624697:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783969396.624701:0:3646:0:(import.c:65:import_set_state_nolock()) ffff93eab6106000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783969396.624705:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783969396.624708:0:3646:0:(import.c:65:import_set_state_nolock()) ffff93eab6106000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783969396.624712:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 238 00000100:00080000:0.0:1783969396.624717:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93eab6106000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969396.624736:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf745f80 x1870627099290368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969396.624760:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099289984:0@lo:400:kworker.0 00000100:00100000:3.0:1783969396.625551:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099290368:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783969396.625636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969396.625784:0:7749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099290368 00000100:00100000:3.0:1783969396.625793:0:7749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099290368 00000100:00100000:3.0:1783969396.625837:0:7749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783969396.625844:0:7749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870627099290368:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1783969396.625867:0:7749:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783969396.625910:0:7749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870627099290368:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 64us (275us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783969396.625917:0:7749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1783969396.625961:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6106000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783969396.625966:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783969396.625969:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099290368:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1783969396.644573:0:3648:0:(import.c:65:import_set_state_nolock()) ffff93e9821a0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783969396.644589:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 214 00000100:00080000:2.0:1783969396.644601:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93e9821a0000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969396.655611:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d23b80 x1870627099290496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783969396.655655:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1870627099289600:0@lo:400:kworker.0 00000100:00100000:0.0:1783969396.655720:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1870627099290496:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783969396.658304:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099289088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969396.660448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969396.660555:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099290496 00000100:00100000:3.0:1783969396.660583:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099290496 00000100:00100000:3.0:1783969396.660634:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783969396.660643:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1870627099290496:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1783969396.660665:0:6523:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783969396.668346:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1870627099290496:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 7690us (7897us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783969396.668367:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1783969396.669881:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e9821a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969396.669908:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783969396.669914:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1870627099290496:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783969397.106252:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099290624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783969397.106347:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969397.106896:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099290624 00000100:00100000:2.0:1783969397.106905:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099290624 00000100:00100000:2.0:1783969397.106968:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783969397.106977:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099290624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969397.107007:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783969397.107066:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099290624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969397.107074:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783969397.107119:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099290624:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1783969397.292897:0:15324:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783969397.303541:0:15324:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1783969397.303617:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.303636:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.303644:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.303651:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.303677:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783969397.303685:0:15324:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783969397.303714:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783969397.303720:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783969397.303726:0:15324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783969397.303734:0:15324:0:(import.c:65:import_set_state_nolock()) ffff93eab9ee2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1783969397.303739:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783969397.303741:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783969397.303760:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783969397.304455:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969397.304467:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.304478:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797c00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969397.304482:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.304493:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969397.304502:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969397.304524:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783969397.304527:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783969397.304530:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783969397.304579:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.304586:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969397.304631:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.304639:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eab7797c00/0xea31253a47cb9b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b21 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.304654:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969397.304656:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969397.304658:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969397.304855:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.304866:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969397.304870:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099290752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969397.304872:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.304878:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969397.304967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969397.305059:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099290752 00000100:00100000:0.0:1783969397.305066:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099290752 00000100:00100000:0.0:1783969397.305114:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783969397.305123:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1870627099290752:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783969397.305130:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783969397 with bad export cookie 16875310210976814568 00010000:00010000:3.0:1783969397.307112:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783969397.307139:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.307164:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.307173:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.307181:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309570:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969397.309590:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309603:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796200 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969397.309608:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309621:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969397.309629:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969397.309657:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783969397.309660:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1783969397.309710:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309717:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969397.309759:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309767:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93eab7796200/0xea31253a47cb9b2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309787:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783969397.309787:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099290880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969397.309791:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309796:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8200 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969397.309799:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309804:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969397.309810:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969397.309815:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783969397.309817:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1783969397.309827:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309837:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969397.309857:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.309864:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969397.309865:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969397.309867:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969397.309881:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099291008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969397.309881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969397.309909:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969397.311216:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783969397.311301:0:15324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad8200/0xea31253a47cb9a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9a09 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969397.311331:0:15324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783969397.311464:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.311474:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969397.311478:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099290880 00010000:00010000:3.0:1783969397.311481:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.311488:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969397.311488:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099290880 00010000:00010000:3.0:1783969397.311504:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783969397.311510:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.311516:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.311521:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969397.311526:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099291008 00010000:00010000:3.0:1783969397.311527:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969397.311528:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099291008 00010000:00010000:3.0:1783969397.311537:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783969397.311540:0:15324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000100:00100000:1.0:1783969397.311543:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 10000000:01000000:3.0:1783969397.311544:0:15324:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000100:00100000:1.0:1783969397.311554:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1870627099290880:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783969397.311561:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783969397 with bad export cookie 16875310210976814568 00000020:01000004:3.0:1783969397.311587:0:15324:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1783969397.311592:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1783969397.311598:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783969397.311610:0:15324:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1783969397.311615:0:15324:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff93e98330e000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783969397.311622:0:15324:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff93e9821a7000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783969397.311626:0:15324:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff93eab6128000) has exports, disconnecting them 00000020:00080000:3.0:1783969397.311631:0:15324:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93e98330e000), last request at 1783969396 00000020:00000080:3.0:1783969397.311640:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb99ca 00000100:00100000:1.0:1783969397.311663:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1870627099290880:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1781us total) trans 0 rc -107/-107 00000100:00080000:3.0:1783969397.311664:0:15324:0:(import.c:65:import_set_state_nolock()) ffff93e983308800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783969397.311670:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969397.311689:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783969397.311693:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1870627099291008:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783969397.311697:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783969397 with bad export cookie 16875310210976814568 00000020:00080000:3.0:1783969397.311719:0:15324:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93e98330e000): rc 0 00000020:00000080:3.0:1783969397.311722:0:15324:0:(genops.c:906:class_export_put()) final put ffff93e98330e000/lustre-MDT0001-lwp-OST0001_UUID 00000100:00100000:1.0:1783969397.311728:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1870627099291008:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (1819us total) trans 0 rc -107/-107 00000020:00080000:3.0:1783969397.311732:0:15324:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93e9821a7000), last request at 1783969396 00000020:00000080:3.0:1783969397.311735:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb98a4 00000100:00100000:1.0:1783969397.311735:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1783969397.311740:0:15324:0:(import.c:65:import_set_state_nolock()) ffff93e9821a0800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783969397.311752:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e98330e000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00080000:1.0:1783969397.311774:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783969397.311778:0:3648:0:(import.c:65:import_set_state_nolock()) ffff93eaa5b1e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783969397.311788:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:3.0:1783969397.311801:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e983308800 for lustre-MDT0001 00010000:00010000:2.0:1783969397.311870:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969397.311878:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.311887:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b600e00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969397.311891:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.311899:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969397.311907:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969397.311914:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783969397.311917:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783969397.311919:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:3.0:1783969397.311953:0:15324:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93e9821a7000): rc 0 00000020:00000080:3.0:1783969397.311957:0:15324:0:(genops.c:906:class_export_put()) final put ffff93e9821a7000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1783969397.311982:0:15324:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffafc3c1b53ae0 00000020:00000080:3.0:1783969397.311996:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e9821a7000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1783969397.312028:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e9821a0800 for lustre-MDT0001 00000100:00080000:3.0:1783969397.312052:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783969397.312063:0:15324:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff93ea867b0700 x1870627099288832/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783969411 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969397.312080:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1783969397.313995:0:15324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783969397.314011:0:15324:0:(import.c:65:import_set_state_nolock()) ffff93eab6104000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1783969397.314107:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969397.314118:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.314179:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0400 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969397.314185:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.314197:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969397.314206:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969397.314213:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783969397.314216:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783969397.314221:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1783969397.324035:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1870627099290752:12345-0@lo:103:ldlm_bl.0 Request processed in 18903us (19060us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783969397.324054:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1783969397.324483:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783969397.336533:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.134@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783969397.336539:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783969397.336550:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d21c00 x1870627099289216/t0(0) o400->MGC192.168.201.134@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783969412 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969397.336567:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e98319c380 x1870627099290752/t0(0) o103->MGC192.168.201.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783969413 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969397.336576:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e98319e680 x1870627099290880/t0(0) o103->MGC192.168.201.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783969413 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969397.336587:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e98319dc00 x1870627099291008/t0(0) o103->MGC192.168.201.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783969413 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783969397.336597:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783969397.336600:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783969397.336602:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1783969397.337126:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783969397.338147:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff93eaa5b1e800 already not connected (conn 1, was 1): DISCONN 00010000:00010000:3.0:1783969397.338169:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783969397.338178:0:3648:0:(import.c:65:import_set_state_nolock()) ffff93eaa5b1e800 MGS: changing import state from DISCONN to CONNECTING 00010000:00010000:3.0:1783969397.338184:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1783969397.338196:0:3648:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 170 00000100:00100000:0.0:1783969397.338209:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099289216:0@lo:400:kworker.0 00000100:00080000:1.0:1783969397.338211:0:3648:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import ffff93eaa5b1e800 using connection 192.168.201.134@tcp/0@lo 00010000:00010000:3.0:1783969397.338212:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.338237:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea813a0400/0xea31253a47cb96eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb96f2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969397.338268:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969397.338271:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969397.338274:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969397.338337:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:3646:1870627099290752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969397.338582:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfed4274-bbe1-4392-be5b-cfbff577e88d:3647:1870627099290880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969397.339888:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783969397.340000:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783969397.340007:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1783969397.340041:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783969397.340115:0:15324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783969397.340161:0:15324:0:(import.c:65:import_set_state_nolock()) ffff93eab725e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783969397.340185:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783969397.340187:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1783969397.340200:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783969397.340268:0:15324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783969397.340279:0:15324:0:(import.c:65:import_set_state_nolock()) ffff93eabf76a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783969397.340312:0:15324:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff93eab6128000) has no exports 00000100:00100000:3.0:1783969397.340428:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfed4274-bbe1-4392-be5b-cfbff577e88d:0:1870627099291264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969397.340439:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099288832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969397.340537:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea867b3800 x1870627099291648/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783969397.340568:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099291392:0@lo:9:umount.0 00000100:00100000:1.0:1783969397.340577:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfed4274-bbe1-4392-be5b-cfbff577e88d:3648:1870627099291008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969397.340666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969397.340717:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099291520:0@lo:9:umount.0 00000100:00100000:1.0:1783969397.340732:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099291392 00000100:00100000:1.0:1783969397.340743:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099291392 00000100:00100000:3.0:1783969397.340750:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969397.340795:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfed4274-bbe1-4392-be5b-cfbff577e88d:3645:1870627099291648:0@lo:250:ptlrpcd_00_02.0 00000100:00100000:1.0:1783969397.340803:0:9974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099291520 00000100:00100000:1.0:1783969397.340809:0:9974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099291520 00000400:00000100:3.0:1783969397.340820:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870627099291648 offset 0 length 520: 4 00000100:00100000:1.0:1783969397.340843:0:9974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783969397.340856:0:9974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1870627099291392:12345-0@lo:9:umount.0 00000100:00100000:3.0:1783969397.340885:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000020:00000080:1.0:1783969397.340899:0:9974:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb98f1 00000100:00100000:3.0:1783969397.340902:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870627099291520:12345-0@lo:9:umount.0 00000100:00080000:1.0:1783969397.340913:0:9974:0:(import.c:65:import_set_state_nolock()) ffff93eab70d0800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783969397.340931:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9a33 00000100:00080000:3.0:1783969397.340945:0:8437:0:(import.c:65:import_set_state_nolock()) ffff93eab725b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783969397.340999:0:9974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:3.0:1783969397.341014:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1783969397.341235:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1870627099291520:12345-0@lo:9:umount.0 Request processed in 340us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969397.341243:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:3.0:1783969397.341281:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783969397.341313:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eabf76a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783969397.341329:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783969397.341331:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783969397.341335:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099291520:0@lo:9:umount.0 00000100:00100000:1.0:1783969397.341471:0:9974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3645:x1870627099291392:12345-0@lo:9:umount.0 Request processed in 617us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969397.341481:0:9974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1783969397.341561:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab725e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783969397.341581:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783969397.341584:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783969397.341588:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099291392:0@lo:9:umount.0 00010000:00010000:1.0:1783969397.341626:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969397.344719:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969397.344787:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.344801:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b600e00/0xea31253a47cb9d97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xea31253a47cb9d9e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969397.344825:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969397.344828:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969397.344831:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969397.345604:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfed4274-bbe1-4392-be5b-cfbff577e88d:0:1870627099291136:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1783969397.359760:0:15324:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff93eab6128000) has no exports 00000020:01000000:0.0:1783969397.447864:0:15324:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93e9830ab360 - data ffff93e981c45510/ffff93e98348d400 00000020:01000000:0.0:1783969397.448092:0:15324:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93eab705e600 - data ffff93eaad233d80/ffff93eab704e400 00000001:00000004:0.0:1783969397.458816:0:15324:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1783969397.505103:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783969397.505115:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1783969397.505126:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783969397.506880:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783969397.506892:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1783969397.506943:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783969397.506947:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783969397.508085:0:8833:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783969397.508093:0:8833:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1783969397.508110:0:8833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1783969397.509172:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783969397.509182:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1783969397.509208:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783969397.509211:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783969397.509651:0:9971:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783969397.509656:0:9971:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1783969397.509667:0:9971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783969397.510696:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb970e 00000020:00000080:1.0:1783969397.510711:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab6108800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783969397.511452:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab6108800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783969397.513030:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9723 00000020:00000080:1.0:1783969397.513046:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab610b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1783969397.513109:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1783969397.513115:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969397.513127:0:15324:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783969397.513132:0:15324:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff93ea84d7cd40) has no exports 00000004:01000000:1.0:1783969397.513446:0:15324:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783969397.513457:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9a2c 00000020:00000080:1.0:1783969397.513462:0:15324:0:(genops.c:906:class_export_put()) final put ffff93e98330a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783969397.513804:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab610b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1783969397.513935:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783969397.513940:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969397.513951:0:15324:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783969397.513955:0:15324:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff93e9834e99c0) has no exports 00000020:00000080:1.0:1783969397.513964:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9a25 00000020:00000080:1.0:1783969397.513969:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eabf768800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1783969397.514517:0:15324:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783969397.514524:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783969397.514529:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1783969397.514536:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783969397.514539:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783969397.514584:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969397.514594:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783969397.514603:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb98ea 00000020:00000080:1.0:1783969397.514609:0:15324:0:(genops.c:906:class_export_put()) final put ffff93e9821a6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1783969397.514614:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783969397.514618:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969397.514622:0:15324:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783969397.514624:0:15324:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff93eab7164d40) has no exports 00000020:00000080:1.0:1783969397.514629:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb98e3 00000020:00000080:1.0:1783969397.514633:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab725d800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1783969397.515017:0:15324:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783969397.515022:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783969397.515024:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1783969397.515028:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783969397.515030:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783969397.515058:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969397.515064:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1783969397.515076:0:15324:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783969397.515092:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9746 00000020:00000080:1.0:1783969397.515097:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab9f06800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1783969397.515102:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1783969397.515105:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969397.515109:0:15324:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783969397.515112:0:15324:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff93eac0e78000) has no exports 00000020:00000080:1.0:1783969397.515116:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb973f 00000020:00000080:1.0:1783969397.515119:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab6103000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783969397.515335:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e98330a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783969397.516165:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eabf768800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783969397.516177:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eabf76a800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783969397.516185:0:38:0:(genops.c:906:class_export_put()) final put ffff93e98330e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783969397.516188:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e98330e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1783969397.516193:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783969397.516306:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e9821a6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783969397.516313:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab725d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783969397.516318:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab725e800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783969397.516324:0:38:0:(genops.c:906:class_export_put()) final put ffff93e982128800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783969397.516327:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e982128800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1783969397.516332:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783969397.516361:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9f06800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783969397.516366:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab6103000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1783969397.536577:0:15324:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1783969397.536589:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783969397.536595:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1783969397.536729:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783969397.536844:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969397.536860:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783969397.536895:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969397.536899:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783969397.536907:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab610b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783969397.536912:0:15324:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab610b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1783969397.536927:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783969397.537159:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb972a 00000020:00000080:1.0:1783969397.537169:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab610c800/lustre-MDD0001_UUID 00000020:00000080:3.0:1783969397.537294:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab6104000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783969397.537304:0:38:0:(genops.c:906:class_export_put()) final put ffff93eab6107000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783969397.537306:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab6107000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1783969397.537329:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783969397.537901:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1783969397.537911:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969397.537919:0:15324:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783969397.537923:0:15324:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff93eab612b380) has no exports 00000020:00000080:1.0:1783969397.537963:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969397.537969:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1783969397.537975:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9731 00000020:00000080:1.0:1783969397.537980:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab610d000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1783969397.537990:0:15324:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93eab929d800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1783969397.537995:0:15324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eab929d800 2 00000020:01000004:1.0:1783969397.537998:0:15324:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93eab929d800 from lustre-MDT0001 00000020:00000080:1.0:1783969397.538027:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969397.538031:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1783969397.538033:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab610e000/lustre-MDT0001_UUID 00000020:00000080:1.0:1783969397.538036:0:15324:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab610e000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1783969397.538046:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1783969397.538091:0:15324:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1783969397.538095:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1783969397.538098:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969397.538101:0:15324:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783969397.538109:0:15324:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff93eab9ee7800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783969397.538115:0:15324:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff93eab61299c0) has exports, disconnecting them 00000020:00080000:1.0:1783969397.538120:0:15324:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff93eab9ee7800), last request at 1783969129 00000020:00000080:1.0:1783969397.538125:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9785 00000020:00080000:1.0:1783969397.538138:0:15324:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93eab9ee7800): rc 0 00000020:00000080:1.0:1783969397.538142:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab9ee7800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783969397.538326:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab610c800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1783969397.538332:0:38:0:(genops.c:906:class_export_put()) final put ffff93eab6109000/lustre-MDD0001_UUID 00000020:00000080:3.0:1783969397.538335:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab6109000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1783969397.538340:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1783969397.538598:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab610d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783969397.538612:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9ee7800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:00010000:3.0:1783969397.553633:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:1.0:1783969397.567516:0:15324:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1783969397.567529:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783969397.567535:0:15324:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783969397.567545:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783969397.567644:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab9ee2000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783969397.567770:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969397.567784:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1783969397.567791:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab9ee1800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1783969397.567796:0:15324:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9ee1800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1783969397.567812:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1783969397.567910:0:15324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eab929d800 1 00000020:00000080:1.0:1783969397.567918:0:15324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb96c1 00000020:00000080:1.0:1783969397.567927:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eaac720000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1783969397.567943:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1783969397.567948:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969397.567954:0:15324:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783969397.568083:0:15324:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff93ea84d799c0) has no exports 00000020:00000080:3.0:1783969397.568175:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eaac720000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783969397.628665:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783969397.628684:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1783969397.628691:0:15324:0:(genops.c:906:class_export_put()) final put ffff93eab929c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783969397.628697:0:15324:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab929c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1783969397.628704:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1783969397.628854:0:15324:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93eab929d000 00000020:01000000:3.0:1783969397.628880:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783969397.628885:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783969397.628891:0:15324:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783969397.628895:0:15324:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff93eac0e799c0) has no exports 00000100:00100000:1.0:1783969397.629287:0:13769:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff93e983c47a00:13769] 5 exiting: rc = 0 00000100:00100000:1.0:1783969397.629460:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93ea82bdd000:6523] 2 exiting: rc = 0 00000100:00100000:1.0:1783969397.629534:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93eab22ef200:6522] 1 exiting: rc = 0 00000100:00100000:0.0:1783969397.629537:0:9027:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff93eab73d7c00:9027] 4 exiting: rc = 0 00000100:00100000:0.0:1783969397.629630:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93eab22ee000:6521] 0 exiting: rc = 1 00000100:00100000:3.0:1783969397.630153:0:7749:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93eab60dda00:7749] 3 exiting: rc = 0 00000100:00100000:0.0:1783969397.630655:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630665:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630672:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630678:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630684:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630690:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630696:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630702:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630709:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630715:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630721:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630739:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630747:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630754:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630761:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630768:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630775:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630798:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630804:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630811:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630817:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630824:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630830:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630835:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630841:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630846:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630851:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630858:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630864:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630871:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630877:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630884:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630890:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630896:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630902:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630909:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630916:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630922:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630928:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630934:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630939:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630945:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630951:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630958:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.630964:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631055:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631062:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631068:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631075:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631081:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631089:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631095:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631108:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631115:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631121:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631127:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631133:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631140:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631157:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631164:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631171:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631179:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631187:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.631195:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.635907:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93ea8674e800:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1783969397.636221:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93ea91eb6400:6524] 0 exiting: rc = 1 00000100:00100000:0.0:1783969397.636443:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636452:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636460:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636468:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636477:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636486:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636493:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636500:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636507:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636517:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636524:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636532:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636539:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636545:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636551:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636557:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636564:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636571:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636578:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636585:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636591:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636597:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636622:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636629:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636635:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636641:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636648:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636654:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636660:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636666:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636671:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636677:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636683:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636689:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636695:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636701:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636707:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636714:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636720:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636726:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636732:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636738:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636745:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636751:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636757:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636763:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636769:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636774:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636780:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636786:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636793:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636799:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636805:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636811:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636817:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636823:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636829:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636842:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636848:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636854:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636860:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636867:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636874:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.636880:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969397.637758:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93ea98742400:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1783969397.637873:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93ea98742000:6527] 1 exiting: rc = 0 00000100:00100000:0.0:1783969397.637947:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.637957:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638036:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638045:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638066:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638074:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638080:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638088:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638095:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638103:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638110:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638117:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638124:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638133:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638139:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638158:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638179:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638188:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638194:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638202:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638452:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638465:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638472:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638479:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638487:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638494:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638501:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638508:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638546:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638555:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638562:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638570:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638576:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638584:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638591:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638599:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638607:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638614:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638620:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638626:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638648:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638658:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638665:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638673:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638680:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638688:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638695:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638702:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638711:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638717:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638725:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638733:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638759:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638770:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638777:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638786:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638794:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638801:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638809:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638816:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638823:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638831:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638839:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.638853:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654111:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93ea913d6600:6529] 1 exiting: rc = 0 00000100:00100000:2.0:1783969397.654318:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93ea84f5ca00:6528] 0 exiting: rc = 1 00000100:00100000:3.0:1783969397.654537:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654546:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654552:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654559:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654566:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654572:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654633:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654638:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654662:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654668:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654674:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654679:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654685:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654690:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654695:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654700:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654705:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654710:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654717:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654722:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654727:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654732:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654738:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654743:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654749:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654753:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654758:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654764:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654770:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654774:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654780:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654785:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654790:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654796:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654803:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654809:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654816:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654821:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654828:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654834:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654839:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654844:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654850:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654863:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654869:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654874:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654880:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654885:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654889:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654894:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654900:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654904:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654910:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654914:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654919:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654924:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654928:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654933:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654938:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654942:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654947:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654951:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654956:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.654962:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.659072:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93ea913d7200:6530] 0 exiting: rc = 1 00000100:00100000:0.0:1783969397.663703:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93ea913d6a00:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1783969397.664082:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664092:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664098:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664104:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664110:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664117:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664124:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664130:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664136:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664153:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664160:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664166:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664171:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664177:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664205:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664211:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664216:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664223:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664238:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664244:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664249:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664255:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664261:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664266:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664272:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664278:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664283:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664288:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664293:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664298:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664304:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664309:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664314:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664320:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664326:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664332:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664340:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664345:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664351:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664356:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664363:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664370:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664376:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664406:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664413:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664419:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664426:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664431:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664437:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664452:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664459:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664465:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664472:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664479:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664485:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664493:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664499:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664505:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664511:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664516:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664522:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664528:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664534:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.664540:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969397.665114:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93ea913d6c00:6532] 0 exiting: rc = 1 00000100:00100000:2.0:1783969397.665165:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93ea913d7e00:6533] 1 exiting: rc = 0 00000100:00100000:3.0:1783969397.665411:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665419:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665425:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665431:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665436:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665442:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665448:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665454:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665461:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665467:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665473:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665478:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665484:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665490:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665495:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665501:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665508:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665514:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665521:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665527:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665547:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665552:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665558:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665564:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665569:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665575:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665581:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665586:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665592:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665598:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665700:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665706:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665712:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665718:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665723:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665729:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665735:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665740:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665746:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665752:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665758:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665764:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665770:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665775:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665781:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665786:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665791:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665797:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665803:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665808:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665813:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665818:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665823:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665828:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665833:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665846:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665851:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665856:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665861:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665865:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665870:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665875:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665880:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969397.665885:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.671044:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93ea91336400:6534] 0 exiting: rc = 1 00000100:00100000:0.0:1783969397.671767:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93ea91337a00:6535] 1 exiting: rc = 0 00000100:00100000:3.0:1783969397.672497:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93ea82b98800:6536] 2 exiting: rc = 0 00000100:00100000:2.0:1783969397.672672:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672683:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672691:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672699:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672706:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672715:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672721:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672727:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672732:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672739:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672771:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672795:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672803:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672809:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672816:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672822:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672829:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672835:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672842:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672848:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672854:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672860:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672867:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672873:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672880:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672886:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672892:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672899:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672905:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672912:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672918:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672926:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672936:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672942:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672951:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672971:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672979:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672985:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672991:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.672996:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673003:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673010:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673017:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673024:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673030:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673044:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673050:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673057:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673063:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673069:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673076:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673084:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673091:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673097:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673103:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673110:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673115:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673121:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673128:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673134:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673140:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673159:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673165:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969397.673171:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783969397.684373:0:15324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969397.684422:0:15324:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1783969397.684429:0:15324:0:(genops.c:906:class_export_put()) final put ffff93ea86021800/MDS_uuid 00000020:00000080:2.0:1783969397.684435:0:15324:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea86021800/MDS_uuid for MDS 00000020:01000000:2.0:1783969397.684448:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1783969397.685788:0:15324:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1783969398.578629:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969399.600544:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969400.627866:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969401.649551:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783969401.712440:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969401.712449:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969401.712452:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969401.712456:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783969401.712460:0:38:0:(import.c:65:import_set_state_nolock()) ffff93e9821a0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969401.712468:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 458 00000100:00080000:3.0:1783969401.712474:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783969401.712481:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93e9821a0000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969401.712519:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d20700 x1870627099291776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969401.712583:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969401.712587:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783969401.712589:0:38:0:(import.c:65:import_set_state_nolock()) ffff93eab6106000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969401.712592:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 458 00000100:00080000:3.0:1783969401.712595:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783969401.712599:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93eab6106000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969401.712612:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d20e00 x1870627099292032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969401.712636:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099291904:0@lo:400:kworker.0 00000100:00100000:3.0:1783969401.712657:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969401.712668:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099292160:0@lo:400:kworker.0 00000100:00100000:1.0:1783969401.712727:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1870627099291776:0@lo:38:kworker.0 00000400:00000100:3.0:1783969401.712754:0:3649:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099292160 offset 0 length 224: 4 00000400:00000100:2.0:1783969401.716132:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099291904 offset 0 length 224: 4 00000400:00000100:1.0:1783969401.736098:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099291776 offset 0 length 520: 4 00000100:00100000:1.0:1783969401.736166:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099292032:0@lo:38:kworker.0 00000400:00000100:1.0:1783969401.736213:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099292032 offset 0 length 520: 4 00010000:00010000:2.0:1783969402.674531:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783969402.689090:0:15525:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783969402.698369:0:15525:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783969402.698926:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969402.698946:0:15525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969402.698955:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969402.698963:0:15525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969402.699936:0:15525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783969402.699947:0:15525:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783969402.699986:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969402.700002:0:15525:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d20700 x1870627099291776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783969416 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969402.700019:0:15525:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783969402.700026:0:15525:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783969402.700034:0:15525:0:(import.c:65:import_set_state_nolock()) ffff93e9821a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783969402.700040:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969402.700044:0:15525:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d20700 x1870627099291776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783969416 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969402.700050:0:15525:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783969402.700054:0:15525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:3.0:1783969402.701224:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969402.701240:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969402.701256:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8c00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969402.701261:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969402.701273:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969402.701281:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969402.701287:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783969402.701290:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783969402.701294:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783969402.701316:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93eaa5b1e800 00010000:00010000:3.0:1783969402.701320:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969402.701333:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad8c00/0xea31253a47cb9afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9b05 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969402.701345:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969402.701347:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969402.701360:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969402.701929:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1870627099291776:0@lo:38:kworker.0 00000100:00080000:0.0:1783969402.703224:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783969402.703243:0:15525:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d23b80 x1870627099291904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969417 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969402.703276:0:15525:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783969402.703286:0:15525:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783969402.703326:0:15525:0:(import.c:65:import_set_state_nolock()) ffff93e9821a1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783969402.703502:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099291904:0@lo:400:kworker.0 00000100:00100000:3.0:1783969402.703743:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1870627099292288:0@lo:39:umount.0 00000400:00000100:3.0:1783969402.703813:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099292288 offset 0 length 224: 4 00000100:00080000:3.0:1783969402.738018:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969402.738029:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969402.738032:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969402.738036:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783969402.738363:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099292416:0@lo:400:kworker.0 00000400:00000100:0.0:1783969402.738467:0:3649:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099292416 offset 0 length 224: 4 00000001:00100000:1.0:1783969402.743229:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783969402.743242:0:9517:0:(genops.c:906:class_export_put()) final put ffff93eab725c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783969402.743566:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab725c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783969402.743631:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab725b000 for lustre-OST0001 00000001:00100000:2.0:1783969402.743980:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783969402.743984:0:8432:0:(genops.c:906:class_export_put()) final put ffff93eab929f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783969402.744077:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab929f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783969402.744110:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab70d0800 for lustre-OST0000 00010000:00010000:3.0:1783969403.701940:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969404.722263:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969405.745689:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783969406.768861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783969406.768877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783969406.768881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783969406.768885:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783969406.769020:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1783969406.769321:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969406.774254:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099292544:0@lo:400:kworker.0 00000400:00000100:1.0:1783969406.774354:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099292544 offset 0 length 224: 4 00010000:00010000:2.0:1783969407.793020:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969407.857123:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969397/real 1783969397] req@ffff93ea867b3800 x1870627099291648/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783969407 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969407.857168:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ea867b3800 x1870627099291648/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783969407 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783969407.857194:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eaa5b1e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969407.857224:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1783969407.857229:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfed4274-bbe1-4392-be5b-cfbff577e88d:3645:1870627099291648:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1783969407.857421:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969407.857427:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783969407.857430:0:38:0:(import.c:65:import_set_state_nolock()) ffff93eaa5b1e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969407.857436:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1783969407.857443:0:38:0:(import.c:589:import_select_connection()) MGC192.168.201.134@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783969407.857452:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import ffff93eaa5b1e800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969407.857490:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d21880 x1870627099292672/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969407.857515:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969407.857520:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783969407.857566:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969407.857581:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099292800:0@lo:400:kworker.0 00000400:00000100:3.0:1783969407.857657:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099292800 offset 0 length 224: 4 00000100:00100000:1.0:1783969407.857670:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfed4274-bbe1-4392-be5b-cfbff577e88d:3645:1870627099292672:0@lo:250:kworker.0 00000400:00000100:1.0:1783969407.857692:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870627099292672 offset 0 length 520: 4 00010000:00010000:3.0:1783969408.818136:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969409.841678:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969410.865274:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969411.888821:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969412.913885:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969412.976585:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969402/real 1783969402] req@ffff93eabf746680 x1870627099292288/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969412 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969412.976629:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93eabf746680 x1870627099292288/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969412 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783969412.976645:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e9821a1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783969412.976668:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1870627099292288:0@lo:39:umount.0 00000100:00080000:2.0:1783969412.976775:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783969412.976781:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783969412.976784:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783969412.976788:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783969412.976958:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099292928:0@lo:400:kworker.0 00000100:00080000:0.0:1783969412.976999:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783969412.977006:0:15525:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783969412.977012:0:15525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000400:00000100:1.0:1783969412.977028:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099292928 offset 0 length 224: 4 00010000:00010000:0.0:1783969412.978684:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969412.978708:0:15525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969412.978717:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969412.978724:0:15525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969412.979005:0:15525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969412.979016:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969412.979024:0:15525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969412.979055:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969412.979062:0:15525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969412.982694:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969412.982716:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969412.982741:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad9400 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969412.982747:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969412.982759:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969412.982768:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969412.982802:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783969412.982806:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1783969412.982824:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93eaa5b1e800 00010000:00010000:2.0:1783969412.982828:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969412.982836:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad9400/0xea31253a47cb9b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9b13 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969412.982856:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969412.982861:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969412.982866:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969412.982868:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969412.982875:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969412.982882:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969412.982887:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783969412.982889:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1783969412.982892:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93eaa5b1e800 00010000:00010000:2.0:1783969412.982902:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969412.982918:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969412.982920:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969412.982923:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969412.987468:0:15525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969412.987492:0:15525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b601600/0xea31253a47cb9d82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9d89 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969412.987516:0:15525:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1783969412.987525:0:15525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1783969412.987527:0:15525:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1783969412.987572:0:15525:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783969412.987578:0:15525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1783969412.987589:0:15525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969412.987596:0:15525:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783969412.987601:0:15525:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff93eab612cd40) has no exports 00000020:00080000:0.0:1783969412.987632:0:15525:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff93eab612cd40) has no exports 00010000:00010000:3.0:1783969412.995567:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783969413.004716:0:15525:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93e982360660 - data ffff93eaad32fd80/ffff93eab7292000 00000020:01000000:1.0:1783969413.004941:0:15525:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93ea996306c0 - data ffff93eaad234bd0/ffff93eab9f11000 00100000:10000000:1.0:1783969413.021731:0:15525:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783969413.044656:0:15525:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb985e 00000020:00000080:3.0:1783969413.044673:0:15525:0:(genops.c:906:class_export_put()) final put ffff93eaac726800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1783969413.044821:0:15525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93eab70d7000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1783969413.044826:0:15525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eab70d7000 2 00000020:01000004:3.0:1783969413.044830:0:15525:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93eab70d7000 from lustre-OST0000 00000020:00000080:3.0:1783969413.044860:0:15525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783969413.044873:0:15525:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1783969413.044877:0:15525:0:(genops.c:906:class_export_put()) final put ffff93eab9ee6800/lustre-OST0000_UUID 00000020:00000080:3.0:1783969413.044887:0:15525:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9ee6800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1783969413.044911:0:15525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1783969413.044973:0:15525:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1783969413.044979:0:15525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783969413.044990:0:15525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783969413.045002:0:15525:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783969413.045011:0:15525:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93e9821a5800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783969413.045017:0:15525:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff93e982194d40) has exports, disconnecting them 00000020:00080000:3.0:1783969413.045034:0:15525:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93e9821a5800), last request at 1783969152 00000020:00000080:3.0:1783969413.045039:0:15525:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9888 00000020:00080000:3.0:1783969413.045050:0:15525:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93e9821a5800): rc 0 00000020:00000080:3.0:1783969413.045056:0:15525:0:(genops.c:906:class_export_put()) final put ffff93e9821a5800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783969413.045301:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eaac726800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783969413.046830:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e9821a5800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783969413.047515:0:15525:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783969413.047522:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783969413.047527:0:15525:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783969413.047535:0:15525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783969413.047993:0:15525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969413.048007:0:15525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1783969413.048015:0:15525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783969413.048021:0:15525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969413.048026:0:15525:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783969413.048036:0:15525:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff93e9821a5000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783969413.048043:0:15525:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff93e982190000) has exports, disconnecting them 00000020:00080000:2.0:1783969413.048048:0:15525:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff93e9821a5000), last request at 1783969152 00000020:00000080:2.0:1783969413.048053:0:15525:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb989d 00000020:00080000:2.0:1783969413.048137:0:15525:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93e9821a5000): rc 0 00000020:00000080:2.0:1783969413.048145:0:15525:0:(genops.c:906:class_export_put()) final put ffff93e9821a5000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783969413.048222:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e9821a0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783969413.048231:0:38:0:(genops.c:906:class_export_put()) final put ffff93eab9ee1000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1783969413.048234:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9ee1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1783969413.048646:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1783969413.051206:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93e9821a5000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1783969413.077055:0:15525:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783969413.077078:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783969413.077084:0:15525:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783969413.077094:0:15525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783969413.077142:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e9821a1800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783969413.077361:0:15525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969413.077373:0:15525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1783969413.077407:0:15525:0:(genops.c:906:class_export_put()) final put ffff93e9821a1000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1783969413.077413:0:15525:0:(genops.c:865:class_export_destroy()) destroying export ffff93e9821a1000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1783969413.077430:0:15525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1783969413.077544:0:15525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eab70d7000 1 00000020:00000080:1.0:1783969413.077566:0:15525:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9826 00000020:00000080:1.0:1783969413.077576:0:15525:0:(genops.c:906:class_export_put()) final put ffff93eab9f01800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783969413.077587:0:15525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783969413.077596:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9f01800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783969413.077606:0:15525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969413.077612:0:15525:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783969413.077617:0:15525:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff93eab920b380) has no exports 00000020:00000080:3.0:1783969413.325368:0:15525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783969413.325457:0:15525:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783969413.325465:0:15525:0:(genops.c:906:class_export_put()) final put ffff93eab70d6800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783969413.325472:0:15525:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab70d6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783969413.325525:0:15525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783969413.325692:0:15525:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93eab70d5800 00000020:02000400:3.0:1783969413.326341:0:15525:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1783969413.936919:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969414.960516:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969415.998037:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969416.051039:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969401/real 1783969401] req@ffff93e983d20e00 x1870627099292032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1783969416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969416.051093:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93e983d20e00 x1870627099292032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1783969416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783969416.051162:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6106000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969416.051194:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783969416.051202:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099292032:0@lo:38:kworker.0 00000100:00080000:3.0:1783969416.051296:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969416.051304:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969416.051307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969416.051311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783969416.051315:0:36:0:(import.c:65:import_set_state_nolock()) ffff93eab6106000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969416.051322:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 463 00000100:00080000:3.0:1783969416.051331:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783969416.051341:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93eab6106000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969416.054422:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d20700 x1870627099293056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783969416.054618:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099293184:0@lo:400:kworker.0 00000400:00000100:3.0:1783969416.054707:0:3649:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099293184 offset 0 length 224: 4 00000100:00100000:1.0:1783969416.063176:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099293056:0@lo:38:kworker.0 00000400:00000100:1.0:1783969416.063286:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099293056 offset 0 length 520: 4 00010000:00010000:1.0:1783969417.009728:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1783969417.075343:0:3649:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969401/real 1783969401] req@ffff93e983d20380 x1870627099292160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969417.103645:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff93e983d20380 x1870627099292160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783969417.103661:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93e983308000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783969417.103665:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783969417.110538:0:3649:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1783969417.112469:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783969417.112480:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783969417.112484:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783969417.112487:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783969417.112490:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783969417.112495:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783969417.112500:0:38:0:(import.c:65:import_set_state_nolock()) ffff93e983308000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783969417.112514:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 238 00000100:00080000:0.0:1783969417.112538:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93e983308000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969417.112596:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf747100 x1870627099293312/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969417.112672:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1870627099293312:0@lo:38:kworker.0 00000400:00000100:0.0:1783969417.112753:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627099293312 offset 0 length 520: 4 00000100:00100000:0.0:1783969417.112853:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099292160:0@lo:400:kworker.0 00010000:00010000:2.0:1783969418.032490:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1783969418.164153:0:3649:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969402/real 1783969402] req@ffff93e983d22a00 x1870627099292416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969418 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969418.196694:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff93e983d22a00 x1870627099292416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969418 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783969418.196708:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff93e983308000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1783969418.196725:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099292416:0@lo:400:kworker.0 00000020:01000004:3.0:1783969418.250086:0:15727:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783969418.270594:0:15727:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783969418.270686:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.270702:0:15727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.270711:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.270718:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.270742:0:15727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783969418.270747:0:15727:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783969418.270772:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969418.270783:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d20700 x1870627099293056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783969436 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.270801:0:15727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783969418.270807:0:15727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783969418.270821:0:15727:0:(import.c:65:import_set_state_nolock()) ffff93eab6106000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783969418.270838:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969418.270841:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d20700 x1870627099293056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783969436 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.270848:0:15727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783969418.270850:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1783969418.271099:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099293056:0@lo:38:kworker.0 00000100:00080000:0.0:1783969418.272300:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783969418.272311:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e98319fb80 x1870627099292544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783969418.272429:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969418.272438:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969418.272447:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad8e00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969418.272451:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969418.272460:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969418.272467:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969418.272473:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783969418.272476:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783969418.272479:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783969418.272497:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93eaa5b1e800 00010000:00010000:3.0:1783969418.272501:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969418.272507:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad8e00/0xea31253a47cb9ae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9ae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969418.272534:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969418.272536:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969418.272538:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969418.272588:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d23b80 x1870627099292800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969423 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.272610:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e98319c700 x1870627099292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969428 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.272623:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d23480 x1870627099293184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969432 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.272634:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93eabf747100 x1870627099293312/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783969427 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.272646:0:15727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783969418.272652:0:15727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783969418.272656:0:15727:0:(import.c:65:import_set_state_nolock()) ffff93e983308000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783969418.272660:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783969418.272664:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e98319fb80 x1870627099292544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969422 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969418.273425:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099292800:0@lo:400:kworker.0 00000100:00100000:2.0:1783969418.273582:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099292928:0@lo:400:kworker.0 00000100:00100000:1.0:1783969418.273638:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099292544:0@lo:400:kworker.0 00000100:00100000:0.0:1783969418.273699:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d23b80 x1870627099292800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969423 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.273709:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e98319c700 x1870627099292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969428 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.273717:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d23480 x1870627099293184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969432 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.273739:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93eabf747100 x1870627099293312/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783969427 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969418.273746:0:15727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783969418.273843:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099293184:0@lo:400:kworker.0 00000100:00100000:1.0:1783969418.274406:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1870627099293312:0@lo:38:kworker.0 00000100:00100000:0.0:1783969418.274520:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783969418.276133:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.276152:0:15727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.276158:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.276165:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.276223:0:15727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969418.276232:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.276237:0:15727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.276243:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969418.276248:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969418.276288:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969418.276295:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969418.276301:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e981ad9a00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:1.0:1783969418.276304:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969418.276318:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969418.276325:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969418.276331:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783969418.276334:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1783969418.276346:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93eaa5b1e800 00010000:00010000:1.0:1783969418.276350:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969418.276356:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e981ad9a00/0xea31253a47cb9af0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9af7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969418.276370:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969418.276373:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969418.276475:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea9b601400 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:1.0:1783969418.276479:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969418.276486:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969418.276491:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969418.276506:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783969418.276508:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1783969418.276513:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93eaa5b1e800 00010000:00010000:1.0:1783969418.276516:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969418.276522:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969418.276523:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969418.276525:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969418.276600:0:15727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969418.276604:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea9b601400/0xea31253a47cb9dba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9dc1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969418.276617:0:15727:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1783969418.276621:0:15727:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1783969418.276623:0:15727:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1783969418.276649:0:15727:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783969418.276653:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783969418.276658:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969418.276663:0:15727:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783969418.276667:0:15727:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff93eab7163380) has no exports 00000020:00080000:0.0:1783969418.276693:0:15727:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff93eab7163380) has no exports 00010000:00010000:2.0:1783969418.278539:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783969418.283731:0:15727:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93e9823605a0 - data ffff93eaad3491b0/ffff93eab7405400 00000020:01000000:1.0:1783969418.284119:0:15727:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff93ea861b15a0 - data ffff93ea98fcd0d8/ffff93e9824dc800 00100000:10000000:2.0:1783969418.323601:0:15727:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783969418.339173:0:15727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9984 00000020:00000080:3.0:1783969418.339183:0:15727:0:(genops.c:906:class_export_put()) final put ffff93eab725b800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1783969418.339201:0:15727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93e98212a000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1783969418.339204:0:15727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93e98212a000 2 00000020:01000004:3.0:1783969418.339206:0:15727:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93e98212a000 from lustre-OST0001 00000020:00000080:3.0:1783969418.339225:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783969418.339234:0:15727:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1783969418.339236:0:15727:0:(genops.c:906:class_export_put()) final put ffff93eabf76b800/lustre-OST0001_UUID 00000020:00000080:3.0:1783969418.339238:0:15727:0:(genops.c:865:class_export_destroy()) destroying export ffff93eabf76b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1783969418.339244:0:15727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1783969418.339339:0:15727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import bfed4274-bbe1-4392-be5b-cfbff577e88d->MGS 00010000:00010000:3.0:1783969418.339350:0:15727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea813a1400/0xea31253a47cb96dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb96e4 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969418.339361:0:15727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea813a1400/0xea31253a47cb96dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb96e4 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969418.339365:0:15727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1783969418.339367:0:15727:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1783969418.339370:0:15727:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1783969418.339397:0:15727:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93eaa5b1e800 00010000:00010000:3.0:1783969418.339400:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea813a1400/0xea31253a47cb96dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb96e4 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969418.339423:0:15727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xea31253a47cb9b60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969418.339427:0:15727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xea31253a47cb9b60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969418.339431:0:15727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783969418.339432:0:15727:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1783969418.339433:0:15727:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1783969418.339441:0:15727:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93eaa5b1e800 00010000:00010000:3.0:1783969418.339442:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cb9b59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xea31253a47cb9b60 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783969418.339454:0:15727:0:(import.c:65:import_set_state_nolock()) ffff93eaa5b1e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1783969418.339456:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783969418.339458:0:15727:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783969418.339459:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783969418.339461:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783969418.339470:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93e983d21880 x1870627099292672/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783969422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783969418.339480:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783969418.339482:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000020:00000080:1.0:1783969418.339590:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab725b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1783969418.339621:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfed4274-bbe1-4392-be5b-cfbff577e88d:3645:1870627099292672:0@lo:250:kworker.0 10000000:01000000:3.0:1783969418.339745:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783969418.339753:0:15727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb95da 00000020:00000080:3.0:1783969418.339758:0:15727:0:(genops.c:906:class_export_put()) final put ffff93ea86023000/bfed4274-bbe1-4392-be5b-cfbff577e88d 00000020:01000000:3.0:1783969418.339797:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.134@tcp (flags='') 00000020:00000080:3.0:1783969418.339803:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783969418.339817:0:15727:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.134@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783969418.339820:0:15727:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff93eaa5b00000) has no exports 10000000:01000000:3.0:1783969418.341268:0:6518:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783969418.341455:0:15727:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.134@tcp: client import never connected 00000100:00080000:0.0:1783969418.341460:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783969418.341462:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783969418.341467:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783969418.341469:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783969418.341630:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93ea86023000/bfed4274-bbe1-4392-be5b-cfbff577e88d for MGC192.168.201.134@tcp 00000020:00000080:0.0:1783969418.342890:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969418.343002:0:15727:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.134@tcp (uuid bfed4274-bbe1-4392-be5b-cfbff577e88d) 00000020:01000000:0.0:1783969418.343012:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783969418.343020:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969418.343025:0:15727:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783969418.343032:0:15727:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93e98330d000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783969418.343038:0:15727:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff93eab92099c0) has exports, disconnecting them 00000020:00080000:0.0:1783969418.343041:0:15727:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93e98330d000), last request at 1783969176 00000020:00000080:0.0:1783969418.343045:0:15727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb99ae 00000020:00080000:0.0:1783969418.343071:0:15727:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93e98330d000): rc 0 00000020:00000080:0.0:1783969418.343076:0:15727:0:(genops.c:906:class_export_put()) final put ffff93e98330d000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1783969418.343420:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eaa5b1e800 for MGC192.168.201.134@tcp 00000020:00000080:1.0:1783969418.343428:0:36:0:(genops.c:906:class_export_put()) final put ffff93eaa5b19000/bfed4274-bbe1-4392-be5b-cfbff577e88d 00000020:00000080:1.0:1783969418.343431:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93eaa5b19000/bfed4274-bbe1-4392-be5b-cfbff577e88d for MGC192.168.201.134@tcp 00000020:01000000:1.0:1783969418.343436:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.134@tcp (bfed4274-bbe1-4392-be5b-cfbff577e88d) 00000020:00000080:1.0:1783969418.344021:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93e98330d000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1783969418.346449:0:15727:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1783969418.346458:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783969418.346463:0:15727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783969418.346470:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783969418.346613:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969418.346622:0:15727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1783969418.346628:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1783969418.346641:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969418.346646:0:15727:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783969418.346653:0:15727:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff93e98330a800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783969418.346659:0:15727:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff93eab920cd40) has exports, disconnecting them 00000020:00080000:1.0:1783969418.346664:0:15727:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff93e98330a800), last request at 1783969176 00000020:00000080:1.0:1783969418.346667:0:15727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb99c3 00000020:00080000:1.0:1783969418.346683:0:15727:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff93e98330a800): rc 0 00000020:00000080:1.0:1783969418.346689:0:15727:0:(genops.c:906:class_export_put()) final put ffff93e98330a800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1783969418.347376:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93eab6106000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783969418.347398:0:36:0:(genops.c:906:class_export_put()) final put ffff93eabf76d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1783969418.347401:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93eabf76d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1783969418.347406:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1783969418.347476:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93e98330a800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1783969418.356527:0:15727:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783969418.356536:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783969418.356542:0:15727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783969418.356549:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783969418.356672:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff93e983308000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1783969418.356689:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1783969418.357518:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1783969418.357667:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1783969418.357827:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93ea84fb4600:6505] 1 exiting: rc = 0 00000100:00100000:3.0:1783969418.357934:0:8453:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff93e981a57200:8453] 2 exiting: rc = 0 00000100:00100000:2.0:1783969418.361372:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93ea84e8d200:6504] 0 exiting: rc = 1 00000100:00100000:0.0:1783969418.361620:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.361922:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93ea89dbbe00:6507] 1 exiting: rc = 0 00000100:00100000:0.0:1783969418.362001:0:7929:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93eab6094600:7929] 3 exiting: rc = 0 00000100:00100000:0.0:1783969418.362468:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93ea91499e00:6508] 2 exiting: rc = 0 00000100:00100000:0.0:1783969418.363460:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93ea901b8a00:6506] 0 exiting: rc = 1 00000100:00100000:3.0:1783969418.363606:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363615:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363620:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363626:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363632:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363638:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363643:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363648:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363653:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363658:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363662:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363667:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363673:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363678:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363683:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363688:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363694:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363699:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363704:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363709:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363714:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363719:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363737:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363742:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363747:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363752:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363758:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363763:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363768:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363773:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363778:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363783:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363788:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363793:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363798:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363803:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363818:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363823:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363828:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363834:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363839:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363844:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363848:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363853:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363857:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363862:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363868:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363873:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.363888:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364012:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364019:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364023:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364026:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364029:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364033:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364037:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364039:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364048:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364106:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364110:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364113:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364117:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364120:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.364128:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783969418.364803:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783969418.364822:0:15727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1783969418.364828:0:15727:0:(genops.c:906:class_export_put()) final put ffff93e98330c800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1783969418.364833:0:15727:0:(genops.c:865:class_export_destroy()) destroying export ffff93e98330c800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1783969418.364838:0:15727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1783969418.365198:0:15727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93e98212a000 1 00000020:00000080:3.0:1783969418.365205:0:15727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea31253a47cb9953 00000020:00000080:3.0:1783969418.365212:0:15727:0:(genops.c:906:class_export_put()) final put ffff93eabf71f800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1783969418.365267:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1783969418.365272:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783969418.365277:0:15727:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783969418.365281:0:15727:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff93e982193380) has no exports 00000020:00000080:0.0:1783969418.367150:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff93eabf71f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1783969418.391602:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969418.391616:0:15727:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1783969418.391622:0:15727:0:(genops.c:906:class_export_put()) final put ffff93e982129800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1783969418.391627:0:15727:0:(genops.c:865:class_export_destroy()) destroying export ffff93e982129800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1783969418.391636:0:15727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1783969418.392288:0:15727:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93e98212a800 00000020:01000000:1.0:1783969418.392322:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1783969418.392328:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969418.392333:0:15727:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783969418.392337:0:15727:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff93eab755cd40) has no exports 00000020:00000080:1.0:1783969418.392366:0:15727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969418.392373:0:15727:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1783969418.392376:0:15727:0:(genops.c:906:class_export_put()) final put ffff93eab9f04800/OSS_uuid 00000020:00000080:1.0:1783969418.392397:0:15727:0:(genops.c:865:class_export_destroy()) destroying export ffff93eab9f04800/OSS_uuid for OSS 00000020:01000000:1.0:1783969418.392403:0:15727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1783969418.392488:0:9974:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff93e983303800:9974] 3 exiting: rc = 0 00000100:00100000:1.0:1783969418.392574:0:14243:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff93e983c46c00:14243] 4 exiting: rc = 0 00000100:00100000:1.0:1783969418.393525:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93eab9ef8c00:8436] 0 exiting: rc = 1 00000100:00080000:1.0:1783969418.395451:0:6517:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1783969418.396777:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93eab732c200:8437] 1 exiting: rc = 0 00000100:00100000:3.0:1783969418.396858:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93eab928dc00:8439] 2 exiting: rc = 0 00000100:00100000:1.0:1783969418.396998:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397008:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397016:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397035:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397065:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397071:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397076:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397081:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397085:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397089:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397094:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397098:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397102:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397107:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397111:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397115:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397120:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397125:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397130:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397135:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397139:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397144:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397150:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397156:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397161:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397165:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397170:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397175:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397179:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397184:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397189:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397195:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397200:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397205:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397239:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397246:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397251:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397256:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397261:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397273:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397278:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397283:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397289:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397294:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397300:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397305:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397310:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397315:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397319:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397324:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397329:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397334:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397339:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397344:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397350:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397355:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397366:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397373:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397416:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397423:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397428:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397434:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397439:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.397444:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.398207:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93eab7547200:8441] 1 exiting: rc = 0 00000100:00100000:2.0:1783969418.398457:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93ea901b9c00:8440] 0 exiting: rc = 1 00000100:00100000:3.0:1783969418.398769:0:10104:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff93e983500200:10104] 2 exiting: rc = 0 00000100:00100000:1.0:1783969418.399596:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399604:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399610:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399615:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399620:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399625:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399630:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399636:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399641:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399659:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399664:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399670:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399675:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399680:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399686:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399691:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399697:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399702:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399707:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399712:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399717:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399722:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399727:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399732:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399737:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399743:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399749:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399754:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399759:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399765:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399770:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399775:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399780:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399785:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399790:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399796:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399800:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399815:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399821:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399826:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399832:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399837:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399842:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399847:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399860:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399865:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399870:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.399876:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400019:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400025:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400031:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400036:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400041:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400046:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400126:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400134:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400138:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400143:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400149:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400154:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400159:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400165:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400170:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969418.400175:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.402256:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93eab7089600:8442] 0 exiting: rc = 1 00000100:00100000:3.0:1783969418.402493:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93eab92b7c00:8444] 2 exiting: rc = 0 00000100:00100000:1.0:1783969418.402748:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93eab92be000:8443] 1 exiting: rc = 0 00000100:00100000:0.0:1783969418.402864:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.402873:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.402891:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403024:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403031:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403037:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403044:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403127:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403136:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403142:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403149:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403155:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403161:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403168:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403183:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403192:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403198:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403204:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403209:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403215:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403221:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403227:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403250:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403256:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403262:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403268:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403273:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403278:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403284:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403290:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403297:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403304:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403311:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403316:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403321:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403327:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403333:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403339:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403362:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403369:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403375:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403416:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403423:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403429:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403435:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403442:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403449:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403456:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403461:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403467:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403473:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403479:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403485:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403491:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403497:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403505:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403511:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403526:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403532:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403538:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403545:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403551:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403573:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.403581:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969418.410446:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93eab7323600:8445] 0 exiting: rc = 1 00000100:00100000:2.0:1783969418.410628:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93eab7322200:8446] 1 exiting: rc = 0 00000100:00100000:0.0:1783969418.410804:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410823:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410828:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410833:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410837:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410842:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410846:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410851:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410856:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410860:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410864:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410869:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410874:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410888:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.410892:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411016:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411021:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411027:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411032:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411037:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411042:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411047:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411122:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411128:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411133:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411138:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411143:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411148:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411167:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411172:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411178:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411183:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411188:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411194:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411200:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411206:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411211:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411216:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411222:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411227:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411231:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411236:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411241:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411246:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411251:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411256:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411261:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411266:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411271:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411276:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411281:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411287:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411291:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411297:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411302:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411308:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411313:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411318:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411323:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411328:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411332:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411337:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411341:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.411355:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969418.412458:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93eab7322a00:8447] 0 exiting: rc = 1 00000100:00100000:2.0:1783969418.412546:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93eab7546400:8448] 1 exiting: rc = 0 00000100:00100000:0.0:1783969418.412652:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412659:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412664:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412669:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412694:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412703:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412708:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412713:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412719:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412725:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412731:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412738:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412744:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412750:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412756:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412762:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412782:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412790:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412797:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412803:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412820:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412827:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412833:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412839:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412845:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412852:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412857:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.412863:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413209:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413220:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413226:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413232:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413238:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413243:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413261:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413267:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413273:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413278:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413284:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413290:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413309:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413316:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413322:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413329:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413334:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413340:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413346:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413351:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413357:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413363:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413369:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413376:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413532:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413539:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413544:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413549:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413555:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413559:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413565:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413571:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413577:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413582:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413587:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969418.413592:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783969418.427858:0:15727:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783969441.203940:0:16491:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783969455.148199:0:17091:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783969455.148205:0:17091:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783969455.148207:0:17091:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783969455.148364:0:17091:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93e98330a000 00000020:01000004:2.0:1783969455.149833:0:17091:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783969455.149845:0:17091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783969455.149875:0:17091:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93e9821919c0) 00000020:00000080:2.0:1783969455.149893:0:17091:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783969455.248720:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.260223:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783969455.264674:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1783969455.266114:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.266859:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.269175:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.272840:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.274108:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.274641:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.274894:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.275251:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.275635:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.275879:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.276244:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.276702:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.276965:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.277460:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.277725:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.277962:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.278827:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.279492:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.279751:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.280032:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.280473:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.280751:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783969455.281000:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783969455.281247:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783969455.284107:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783969455.284750:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783969455.284948:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783969455.285224:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783969455.285675:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783969455.285871:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783969455.286049:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783969455.286487:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783969455.286938:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783969455.289662:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.290455:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783969455.291482:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.291794:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783969455.292095:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.292714:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.293700:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783969455.293948:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783969455.294143:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.294648:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783969455.295500:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.301111:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.302896:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.303440:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.305429:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.305745:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1783969455.306493:0:17091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:2.0:1783969455.307000:0:17091:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783969455.308809:0:17091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783969455.308820:0:17091:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783969455.308833:0:17091:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cbabac 00000020:01000004:3.0:1783969455.308842:0:17091:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783969455.308847:0:17091:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783969455.308852:0:17091:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93e98330a000 from MGS 00000020:01000004:3.0:1783969455.308873:0:17091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783969455.308886:0:17091:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93e9834e99c0) 00000020:00000080:3.0:1783969455.308900:0:17091:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783969455.308960:0:17091:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93e98330a000 from MGS, refs=2 00080000:01000000:3.0:1783969455.308965:0:17091:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783969455.308969:0:17091:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cbabba 00000100:00100000:3.0:1783969455.309080:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783969455.309204:0:17091:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783969455.309243:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783969455.312050:0:17091:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783969455.312065:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783969455.313807:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969455.314043:0:17091:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783969455.314048:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783969455.319035:0:17091:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783969455.319048:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783969455.319665:0:17091:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783969455.319673:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783969455.320543:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969455.320548:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969455.320550:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969455.320804:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969455.320807:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969455.320809:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969455.321271:0:17091:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1783969455.331625:0:17091:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:0.0:1783969455.334280:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783969455.336316:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783969455.336358:0:17091:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783969455.336439:0:17091:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783969455.339193:0:17091:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783969455.339560:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969455.339735:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783969455.339742:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783969455.340530:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783969455.340537:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783969455.343224:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783969455.343238:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783969455.344243:0:17091:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783969455.344265:0:17091:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.134@tcp' 00000020:01000004:0.0:1783969455.344266:0:17091:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783969455.344465:0:17091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.134@tcp (typ=mgc) 00000020:00000080:0.0:1783969455.344478:0:17091:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.134@tcp (ffff93eab71619c0) 00000020:00000080:0.0:1783969455.344494:0:17091:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783969455.344578:0:17091:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93e983f70000@MGC192.168.201.134@tcp: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969455.344727:0:17091:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.134@tcp-0 is initialized 00000040:01000000:0.0:1783969455.344734:0:17091:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 1 is initialized 00000100:00080000:1.0:1783969455.346116:0:17108:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1783969455.357561:0:17109:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783969455.357616:0:17091:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.134@tcp (uuid 451c11fa-8d33-493c-b495-458f5de7342a) 00000020:00000080:2.0:1783969455.357636:0:17091:0:(genops.c:1406:class_connect()) connect: client 451c11fa-8d33-493c-b495-458f5de7342a, cookie 0xea31253a47cbabc8 00000100:00080000:2.0:1783969455.357648:0:17091:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783969455.357660:0:17091:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import ffff93e983f70000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969455.357691:0:17091:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e98319c700 x1870627099293440/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969455.357738:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:451c11fa-8d33-493c-b495-458f5de7342a:3645:1870627099293440:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783969455.357800:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.357858:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099293440 00000100:00100000:2.0:1783969455.359059:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099293440 00000100:00100000:2.0:1783969455.360335:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969455.360345:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1870627099293440:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783969455.360372:0:17105:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 451c11fa-8d33-493c-b495-458f5de7342a@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:2.0:1783969455.360420:0:17105:0:(genops.c:1406:class_connect()) connect: client 451c11fa-8d33-493c-b495-458f5de7342a, cookie 0xea31253a47cbabcf 00000100:00080000:2.0:1783969455.360535:0:17105:0:(import.c:65:import_set_state_nolock()) ffff93e98330e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969455.360619:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+5:3645:x1870627099293440:12345-0@lo:250:mount.lustre.0 Request processed in 273us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.360627:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969455.361588:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783969455.361600:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.134@tcp: connect to target with instance 0 00000100:00080000:3.0:1783969455.361608:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783969455.361612:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783969455.361616:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e983f70000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783969455.361619:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783969455.361629:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783969455.361635:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:451c11fa-8d33-493c-b495-458f5de7342a:3645:1870627099293440:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1783969455.364170:0:17091:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 451c11fa-8d33-493c-b495-458f5de7342a->MGS 00000020:01000004:2.0:1783969455.364197:0:17091:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783969455.364204:0:17091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783969455.364228:0:17091:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93e982193380) 00000020:00000080:2.0:1783969455.364247:0:17091:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1783969455.379788:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969455.379942:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1783969455.379948:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783969455.381673:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783969455.382463:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783969455.384228:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783969455.384242:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1783969455.385174:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969455.385376:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1783969455.385415:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783969455.386530:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783969455.386541:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783969455.475854:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969455.476036:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783969455.476041:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783969455.480183:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783969455.480214:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783969455.481840:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969455.482004:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783969455.482010:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783969455.485031:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783969455.485042:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783969455.487132:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969455.487627:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783969455.487634:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783969455.494332:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783969455.494367:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783969455.495647:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969455.495833:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783969455.495839:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783969455.497531:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783969455.497552:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783969455.530511:0:17091:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969455.530705:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783969455.530712:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783969455.532038:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783969455.532048:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783969455.533116:0:17091:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783969455.533126:0:17091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783969455.533988:0:17091:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783969455.534013:0:17091:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783969455.534020:0:17091:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783969455.534119:0:17091:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783969455.534151:0:17091:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783969455.534156:0:17091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783969455.534158:0:17091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783969455.534159:0:17091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969455.534161:0:17091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969455.534162:0:17091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969455.534164:0:17091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969455.534165:0:17091:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969455.534167:0:17091:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783969455.534168:0:17091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969455.534170:0:17091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969455.534172:0:17091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783969455.534174:0:17091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783969455.534175:0:17091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783969455.534176:0:17091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969455.534177:0:17091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969455.534178:0:17091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969455.534179:0:17091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969455.534180:0:17091:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969455.534180:0:17091:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783969455.534181:0:17091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969455.534182:0:17091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969455.534218:0:17091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783969455.534237:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099293568:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783969455.534630:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.534695:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da180 going to sleep for 11 seconds 00000100:00100000:0.0:1783969455.534773:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099293568 00000100:00100000:0.0:1783969455.534782:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099293568 00000100:00100000:0.0:1783969455.534840:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969455.534849:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+5:17091:x1870627099293568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783969455.534902:0:17107:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783969455.534905:0:17107:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783969455.534908:0:17107:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1783969455.535240:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783969455.535803:0:17107:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1783969455.537195:0:17129:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783969455.537202:0:17129:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783969455.537216:0:17129:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783969455.537218:0:17129:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783969455.537610:0:17129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1783969455.537816:0:17107:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783969455.537827:0:17107:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783969455.539303:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+5:17091:x1870627099293568:12345-0@lo:253:mount.lustre.0 Request processed in 4440us (4658us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969455.539322:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969455.539572:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099293568:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783969455.539587:0:17091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783969455.539590:0:17091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969455.539592:0:17091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783969455.539593:0:17091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969455.539594:0:17091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969455.539596:0:17091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969455.539597:0:17091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969455.539598:0:17091:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969455.539600:0:17091:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783969455.539601:0:17091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969455.539603:0:17091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783969455.539625:0:17091:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93e98330a000 from lustre-MDT0000 10000000:01000000:2.0:1783969455.539650:0:17091:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783969455.539653:0:17091:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783969455.539657:0:17091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93eab71619c0 10000000:01000000:2.0:1783969455.539661:0:17091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783969455.539668:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff93eab71619c0 from 1 10000000:01000000:2.0:1783969455.539671:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783969455.539704:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.539715:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.539723:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969455.539742:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099293696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969455.539784:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.539861:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90dad80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969455.539900:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099293696 00000100:00100000:0.0:1783969455.539905:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099293696 00000100:00100000:0.0:1783969455.539971:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969455.539980:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+5:17091:x1870627099293696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969455.539993:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969455.540007:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdfa00/0xea31253a47cbabe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbabdd expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.540029:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdfa00/0xea31253a47cbabe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbabdd expref: 6 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.540039:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdfa00/0xea31253a47cbabe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbabdd expref: 6 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.540048:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdfa00, rc 0) 00000100:00100000:0.0:1783969455.540087:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+6:17091:x1870627099293696:12345-0@lo:101:mount.lustre.0 Request processed in 108us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969455.540093:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969455.540147:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099293696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969455.540160:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969455.540175:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969455.540245:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099293824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969455.540271:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969455.540489:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.540576:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099293824 00000100:00100000:2.0:1783969455.540581:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099293824 00000100:00100000:2.0:1783969455.540604:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969455.540611:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+6:17091:x1870627099293824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969455.540690:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+6:17091:x1870627099293824:12345-0@lo:501:mount.lustre.0 Request processed in 78us (417us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969455.540697:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969455.540757:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099293824:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783969455.540783:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783969455.540802:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969455.540812:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969455.540820:0:17091:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93e98330a000 10000000:01000000:1.0:1783969455.540824:0:17091:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783969455.540829:0:17091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93e98330a000 10000000:01000000:1.0:1783969455.540832:0:17091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783969455.540835:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff93e98330a000 from 1 10000000:01000000:1.0:1783969455.540838:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783969455.540855:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983de7400/0xea31253a47cbabeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969455.540862:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e983de7400/0xea31253a47cbabeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969455.540871:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e983de7400/0xea31253a47cbabeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969455.540889:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099293952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783969455.540913:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969455.540931:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.540975:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099293952 00000100:00100000:2.0:1783969455.540979:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099293952 00000100:00100000:2.0:1783969455.540995:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969455.541000:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+6:17091:x1870627099293952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969455.541007:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969455.541018:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea83dae000/0xea31253a47cbabf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbabeb expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.541030:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea83dae000/0xea31253a47cbabf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbabeb expref: 7 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.541038:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea83dae000/0xea31253a47cbabf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbabeb expref: 7 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.541046:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae000, rc 0) 00000100:00100000:2.0:1783969455.541078:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+7:17091:x1870627099293952:12345-0@lo:101:mount.lustre.0 Request processed in 78us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.541084:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969455.541135:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099293952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969455.541145:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e983de7400/0xea31253a47cbabeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabf2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969455.541152:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e983de7400/0xea31253a47cbabeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbabf2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969455.541162:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783969455.541177:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983de7400/0xea31253a47cbabeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabf2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969455.541183:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e983de7400/0xea31253a47cbabeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabf2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969455.541189:0:17091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783969455.541193:0:17091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783969455.541196:0:17091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93e98330a000 10000000:01000000:1.0:1783969455.541199:0:17091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783969455.541201:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783969455.541203:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783969455.541226:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983de7000/0xea31253a47cbabf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969455.541232:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e983de7000/0xea31253a47cbabf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969455.541246:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e983de7000/0xea31253a47cbabf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969455.541257:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099294080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783969455.541290:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969455.541309:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.541531:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099294080 00000100:00100000:2.0:1783969455.541541:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099294080 00000100:00100000:2.0:1783969455.541559:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969455.541565:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+7:17091:x1870627099294080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969455.541572:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969455.541579:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea83dae800/0xea31253a47cbac00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbabf9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.541593:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea83dae800/0xea31253a47cbac00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbabf9 expref: 8 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.541601:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea83dae800/0xea31253a47cbac00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbabf9 expref: 8 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.541608:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae800, rc 0) 00000100:00100000:2.0:1783969455.541642:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+8:17091:x1870627099294080:12345-0@lo:101:mount.lustre.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.541648:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783969455.541703:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099294080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969455.541713:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e983de7000/0xea31253a47cbabf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbac00 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969455.541721:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e983de7000/0xea31253a47cbabf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbac00 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969455.541763:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099294208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969455.541785:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969455.541811:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.541848:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099294208 00000100:00100000:2.0:1783969455.541852:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099294208 00000100:00100000:2.0:1783969455.541868:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969455.541873:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+8:17091:x1870627099294208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969455.541981:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+9:17091:x1870627099294208:12345-0@lo:501:mount.lustre.0 Request processed in 106us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.541988:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783969455.542044:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099294208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969455.542068:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099294336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969455.542102:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969455.542122:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.542159:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099294336 00000100:00100000:2.0:1783969455.542163:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099294336 00000100:00100000:2.0:1783969455.542178:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969455.542184:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+9:17091:x1870627099294336:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969455.542894:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+9:17091:x1870627099294336:12345-0@lo:503:mount.lustre.0 Request processed in 705us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.542903:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969455.542978:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099294336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969455.543716:0:17130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17130:1870627099294464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969455.543756:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969455.543788:0:17130:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.543834:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099294464 00000100:00100000:2.0:1783969455.543839:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099294464 00000100:00100000:2.0:1783969455.543869:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969455.543875:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+9:17130:x1870627099294464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969455.544492:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+9:17130:x1870627099294464:12345-0@lo:502:llog_process_th.0 Request processed in 614us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.544500:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969455.544590:0:17130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17130:1870627099294464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969455.544617:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969455.544628:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969455.544631:0:17130:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783969455.544636:0:17130:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783969455.544639:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783969455.544654:0:17130:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93eab755b380) 00000020:00000080:1.0:1783969455.544680:0:17130:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783969455.544686:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783969455.544776:0:17130:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783969455.544783:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cbac0e 00000020:00000080:1.0:1783969455.544997:0:17130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783969455.545002:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969455.545005:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969455.545006:0:17130:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783969455.545008:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969455.545012:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969455.545013:0:17130:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783969455.545016:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783969455.545022:0:17130:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93eab75599c0) 00000020:00000080:1.0:1783969455.545031:0:17130:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783969455.545035:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783969455.545037:0:17130:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783969455.545040:0:17130:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783969455.545045:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783969455.545081:0:17130:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93e98330a000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783969455.545093:0:17130:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93eab755cd40) 00000020:00000080:1.0:1783969455.545101:0:17130:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783969455.545161:0:17130:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783969455.545167:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cbac23 00000020:00000080:1.0:1783969455.545267:0:17130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783969455.546500:0:17130:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783969455.546526:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xea31253a47cbac2a 00080000:01000000:1.0:1783969455.546537:0:17130:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783969455.546543:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cbac31 00010000:00010000:3.0:1783969455.609047:0:17130:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1783969455.609687:0:17130:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1783969455.609950:0:17130:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783969455.610595:0:17130:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93e9834ecd40) 00000020:00000080:3.0:1783969455.610613:0:17130:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783969455.610698:0:17130:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783969455.610705:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cbac3f 00000020:00000080:3.0:1783969455.611166:0:17130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783969455.613669:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xea31253a47cbac46 00000020:00000080:3.0:1783969455.615415:0:17130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783969455.615430:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969455.615437:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.615439:0:17130:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783969455.615444:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783969455.615447:0:17130:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1783969455.615448:0:17130:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783969455.615450:0:17130:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783969455.615452:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783969455.615454:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.615455:0:17130:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783969455.615458:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969455.615463:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.615464:0:17130:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783969455.615469:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783969455.615525:0:17130:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783969455.615541:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969455.615545:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.615546:0:17130:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783969455.615548:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969455.615551:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.615552:0:17130:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783969455.615555:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783969455.615561:0:17130:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:00000080:3.0:1783969455.615585:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969455.615599:0:17130:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff93e9834e8000) 00000020:00000080:3.0:1783969455.615615:0:17130:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783969455.615620:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783969455.615676:0:17130:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783969455.615683:0:17130:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783969455.615689:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cbac54 00010000:00080000:3.0:1783969455.615719:0:17130:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eab6109800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1783969455.617309:0:17130:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1783969455.628740:0:17130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783969455.628757:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783969455.628797:0:17130:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783969455.628817:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cbac5b 00000100:00080000:3.0:1783969455.628828:0:17130:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969455.628834:0:17130:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93eab6109800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969455.628873:0:17130:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d23480 x1870627099294592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969455.628962:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099294592:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969455.629034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783969455.629081:0:17130:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783969455.629152:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969455.629156:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.629158:0:17130:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783969455.629166:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783969455.629170:0:17130:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783969455.629172:0:17130:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783969455.629173:0:17130:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783969455.629175:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783969455.629177:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.629179:0:17130:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783969455.629181:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783969455.629186:0:17130:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783969455.629190:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.629192:0:17130:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783969455.629195:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783969455.629198:0:17130:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:3.0:1783969455.629233:0:17130:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783969455.629236:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969455.629248:0:17130:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93e9834eb380) 00000020:00000080:3.0:1783969455.629260:0:17130:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1783969455.629265:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783969455.629458:0:17130:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783969455.629464:0:17130:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783969455.629470:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cbac69 00010000:00080000:3.0:1783969455.629497:0:17130:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ea88952800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1783969455.629728:0:17130:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1783969455.630756:0:17130:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783969455.631060:0:17130:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1783969455.634354:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099294592 00000100:00100000:1.0:1783969455.634367:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099294592 00000100:00100000:1.0:1783969455.634429:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969455.634439:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099294592:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1783969455.634458:0:17117:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:3.0:1783969455.637695:0:17130:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969455.638677:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783969455.646670:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1783969455.648827:0:17136:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783969455.648836:0:17136:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783969455.650013:0:17130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783969455.650027:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783969455.650064:0:17130:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783969455.650083:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cbac70 00000100:00080000:3.0:1783969455.650159:0:17130:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969455.650174:0:17130:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ea88952800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969455.650227:0:17130:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d23b80 x1870627099294720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969455.650292:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099294720:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783969455.650344:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099294720 offset 0 length 520: 4 00000100:00080000:3.0:1783969455.650529:0:17130:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783969455.650672:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969455.650677:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.650679:0:17130:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783969455.650682:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783969455.650684:0:17130:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1783969455.650686:0:17130:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783969455.650687:0:17130:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783969455.650688:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783969455.650691:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.650692:0:17130:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783969455.650694:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783969455.650698:0:17130:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783969455.650701:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.650703:0:17130:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783969455.650706:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783969455.650708:0:17130:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:3.0:1783969455.650728:0:17130:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783969455.650730:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969455.650742:0:17130:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93eac0e799c0) 00000020:00000080:3.0:1783969455.650754:0:17130:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1783969455.650760:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783969455.650815:0:17130:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783969455.650821:0:17130:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1783969455.650827:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea31253a47cbac7e 00010000:00080000:3.0:1783969455.650854:0:17130:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eab9286000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1783969455.651041:0:17130:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1783969455.651176:0:17130:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783969455.651196:0:17130:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783969455.664712:0:17130:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969455.664895:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1783969455.665039:0:17130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1783969455.665750:0:17138:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783969455.665755:0:17138:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783969455.666314:0:17130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783969455.666327:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783969455.666362:0:17130:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783969455.666627:0:17130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cbac85 00000100:00080000:3.0:1783969455.666639:0:17130:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969455.666644:0:17130:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93eab9286000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969455.666733:0:17130:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e98319d180 x1870627099294848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969455.666762:0:17130:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783969455.666816:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969455.666820:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969455.666822:0:17130:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783969455.666826:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969455.666835:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969455.666837:0:17130:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783969455.666840:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783969455.666842:0:17130:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783969455.666845:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969455.666847:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969455.666849:0:17130:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783969455.666851:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969455.666854:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969455.666856:0:17130:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783969455.666860:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783969455.666889:0:17130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17130:1870627099294976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969455.666962:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.667006:0:17130:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969455.667422:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099294848:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783969455.667451:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099294848 offset 0 length 520: 4 00000100:00100000:3.0:1783969455.667487:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099294976 00000100:00100000:3.0:1783969455.667492:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099294976 00000100:00100000:3.0:1783969455.667531:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783969455.667685:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+9:17130:x1870627099294976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969455.667793:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+9:17130:x1870627099294976:12345-0@lo:502:llog_process_th.0 Request processed in 109us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.667846:0:17130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17130:1870627099294976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969455.667871:0:17130:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969455.667876:0:17130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969455.667878:0:17130:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783969455.667882:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1783969455.667930:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1783969455.667948:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783969455.667961:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983de7000/0xea31253a47cbabf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbac00 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.667972:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e983de7000/0xea31253a47cbabf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbac00 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969455.667980:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93e98330a000 from 1 10000000:01000000:2.0:1783969455.667983:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783969455.668005:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.668023:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.668034:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969455.668047:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969455.668071:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.668095:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969455.668548:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099295104 00000100:00100000:0.0:1783969455.668553:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099295104 00000100:00100000:0.0:1783969455.668571:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783969455.668578:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+10:17091:x1870627099295104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969455.668587:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969455.668606:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbac8c expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.668626:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbac8c expref: 11 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.668636:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbac8c expref: 11 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.668645:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde800, rc 0) 00000100:00100000:0.0:1783969455.668685:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+11:17091:x1870627099295104:12345-0@lo:101:mount.lustre.0 Request processed in 106us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969455.668692:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783969455.668809:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969455.668822:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.668831:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969455.669339:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295232:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783969455.669378:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.669424:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969455.669632:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099295232 00000100:00100000:0.0:1783969455.669636:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099295232 00000100:00100000:0.0:1783969455.669663:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969455.669669:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+11:17091:x1870627099295232:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783969455.669683:0:17106:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783969455.669689:0:17106:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783969455.669759:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+11:17091:x1870627099295232:12345-0@lo:256:mount.lustre.0 Request processed in 89us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969455.669766:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969455.669829:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295232:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783969455.670353:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783969455.670370:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.670409:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969455.670461:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e98330a000 from 1 10000000:01000000:2.0:1783969455.670464:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969455.670487:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.670496:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.670505:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969455.670520:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969455.670563:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.670581:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969455.670813:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099295360 00000100:00100000:0.0:1783969455.670818:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099295360 00000100:00100000:0.0:1783969455.670847:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969455.670854:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+11:17091:x1870627099295360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969455.670876:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969455.670888:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbac9a expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.670917:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbac9a expref: 12 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.670927:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbac9a expref: 12 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.670936:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde000, rc 0) 00000100:00100000:0.0:1783969455.670973:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:17091:x1870627099295360:12345-0@lo:101:mount.lustre.0 Request processed in 119us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969455.670979:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969455.671056:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969455.671187:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969455.671200:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.671219:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969455.671336:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969455.671365:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.671420:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969455.671470:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099295488 00000100:00100000:0.0:1783969455.671475:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099295488 00000100:00100000:0.0:1783969455.671506:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969455.671512:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+11:17091:x1870627099295488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969455.671696:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+11:17091:x1870627099295488:12345-0@lo:501:mount.lustre.0 Request processed in 183us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969455.671705:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783969455.672242:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969455.672352:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969455.672448:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.672474:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969455.672527:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099295616 00000100:00100000:0.0:1783969455.672531:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099295616 00000100:00100000:0.0:1783969455.672636:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969455.672643:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+11:17091:x1870627099295616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969455.672719:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+11:17091:x1870627099295616:12345-0@lo:503:mount.lustre.0 Request processed in 76us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969455.672727:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783969455.673075:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099295616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969455.674106:0:17140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17140:1870627099295744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969455.674159:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969455.674195:0:17140:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1783969455.674423:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099295744 00000100:00100000:3.0:1783969455.674429:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099295744 00000100:00100000:0.0:1783969455.674750:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099294592:12345-0@lo:38:llog_process_th.0 Request processed in 40310us (45714us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783969455.674774:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969455.674928:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783969455.674938:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+11:17140:x1870627099295744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969455.679458:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+11:17140:x1870627099295744:12345-0@lo:502:llog_process_th.0 Request processed in 4512us (5288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969455.679473:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969455.679729:0:17140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17140:1870627099295744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969455.679763:0:17140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969455.679772:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.679775:0:17140:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783969455.679782:0:17140:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93e98330a000 00000020:00000080:3.0:1783969455.679785:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783969455.679793:0:17140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969455.679795:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.679805:0:17140:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783969455.679808:0:17140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969455.679811:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.679812:0:17140:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783969455.679815:0:17140:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93e98330a000 00000020:00000080:3.0:1783969455.679817:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783969455.679892:0:17140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969455.679897:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.679898:0:17140:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783969455.679900:0:17140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969455.679903:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.679904:0:17140:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783969455.679907:0:17140:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93e98330a000 00000020:00000080:3.0:1783969455.679909:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783969455.679927:0:17140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969455.679929:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.679931:0:17140:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783969455.679933:0:17140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969455.679935:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.679937:0:17140:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783969455.679940:0:17140:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93e98330a000 00000020:00000080:3.0:1783969455.679942:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783969455.679988:0:17140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17140:1870627099295872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969455.680035:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969455.680068:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099295872 00000100:00100000:3.0:1783969455.680074:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099295872 00000100:00100000:3.0:1783969455.680111:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969455.680119:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+11:17140:x1870627099295872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969455.680228:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+11:17140:x1870627099295872:12345-0@lo:502:llog_process_th.0 Request processed in 109us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969455.680235:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969455.680292:0:17140:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969455.680304:0:17140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17140:1870627099295872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969455.680320:0:17140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969455.680324:0:17140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969455.680326:0:17140:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783969455.680329:0:17140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783969455.680424:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783969455.680443:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969455.680459:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.680470:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969455.680512:0:17091:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783969455.680517:0:17091:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93e98330a000 10000000:01000000:3.0:1783969455.680520:0:17091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93e98330a000 10000000:01000000:3.0:1783969455.680524:0:17091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969455.680529:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93e98330a000 from 1 10000000:01000000:3.0:1783969455.680541:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969455.680565:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52600/0xea31253a47cbaca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.680574:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a52600/0xea31253a47cbaca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.680583:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a52600/0xea31253a47cbaca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969455.680596:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099296000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783969455.680631:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969455.680649:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb0900 going to sleep for 11 seconds 00000100:00080000:2.0:1783969455.684663:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969455.684676:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783969455.684682:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099294592:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969455.685597:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099296000 00000100:00100000:2.0:1783969455.685609:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099296000 00000100:00100000:2.0:1783969455.685676:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783969455.685688:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+11:17091:x1870627099296000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969455.685703:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969455.685723:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea83dafe00/0xea31253a47cbacaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbaca8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.685752:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea83dafe00/0xea31253a47cbacaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbaca8 expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.685764:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea83dafe00/0xea31253a47cbacaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbaca8 expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.685773:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dafe00, rc 0) 00000100:00100000:2.0:1783969455.685853:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:17091:x1870627099296000:12345-0@lo:101:mount.lustre.0 Request processed in 167us (5219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.685872:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969455.686133:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099296000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969455.686152:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a52600/0xea31253a47cbaca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbacaf expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.686163:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52600/0xea31253a47cbaca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbacaf expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969455.686250:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099296128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969455.686303:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969455.686340:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb0900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.686671:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099296128 00000100:00100000:2.0:1783969455.686676:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099296128 00000100:00100000:2.0:1783969455.686711:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783969455.686719:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea90984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+12:17091:x1870627099296128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969455.686832:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea90984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+12:17091:x1870627099296128:12345-0@lo:501:mount.lustre.0 Request processed in 114us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.686839:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969455.686948:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099296128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969455.686978:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099296256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969455.687019:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969455.687046:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb0900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.693065:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099296256 00000100:00100000:2.0:1783969455.693078:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099296256 00000100:00100000:2.0:1783969455.693144:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783969455.693153:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:17091:x1870627099296256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969455.693328:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:17091:x1870627099296256:12345-0@lo:503:mount.lustre.0 Request processed in 175us (6308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.693336:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783969455.693412:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099296256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969455.694514:0:17142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17142:1870627099296384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969455.697365:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969455.697429:0:17142:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84e48840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.697490:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099296384 00000100:00100000:2.0:1783969455.697498:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099296384 00000100:00100000:2.0:1783969455.697552:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783969455.697562:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:17142:x1870627099296384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969455.697698:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:17142:x1870627099296384:12345-0@lo:502:llog_process_th.0 Request processed in 137us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.697705:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783969455.697800:0:17142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17142:1870627099296384:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783969455.698073:0:17142:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783969455.698092:0:17142:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93eab7163380) 00000020:00000080:0.0:1783969455.698112:0:17142:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1783969455.698661:0:17142:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93e98330a000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783969455.698666:0:17142:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93e98330a000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783969455.698669:0:17142:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93e98330a000 4 00010000:00080000:0.0:1783969455.698699:0:17142:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93e9837e4800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969455.704102:0:17142:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1783969455.704218:0:17142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783969455.704264:0:17142:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783969455.704278:0:17142:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xea31253a47cbacbd 00000100:00080000:0.0:1783969455.704288:0:17142:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969455.704295:0:17142:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93e9837e4800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969455.704328:0:17142:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf746a00 x1870627099296512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783969455.704361:0:17142:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783969455.707729:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099296512:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783969455.710976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969455.711328:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099296512 00000100:00100000:0.0:1783969455.711344:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099296512 00000100:00100000:0.0:1783969455.711411:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969455.711419:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099296512:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783969455.711515:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099296512:12345-0@lo:38:llog_process_th.0 Request processed in 95us (551us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783969455.711523:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969455.713032:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783969455.713058:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e9837e4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969455.713068:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783969455.713075:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099296512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783969455.716124:0:17142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17142:1870627099296640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969455.716449:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969455.716487:0:17142:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84e48840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.716806:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099296640 00000100:00100000:2.0:1783969455.716814:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099296640 00000100:00100000:2.0:1783969455.716859:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783969455.716867:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:17142:x1870627099296640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969455.717003:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:17142:x1870627099296640:12345-0@lo:502:llog_process_th.0 Request processed in 136us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.717019:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783969455.717653:0:17142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17142:1870627099296640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969455.717700:0:17142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17142:1870627099296768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969455.717731:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969455.717757:0:17142:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83ef7000 going to sleep for 11 seconds 00000100:00100000:3.0:1783969455.717765:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099296768 00000100:00100000:3.0:1783969455.717771:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099296768 00000100:00100000:3.0:1783969455.717804:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969455.717810:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+12:17142:x1870627099296768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969455.717898:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+12:17142:x1870627099296768:12345-0@lo:502:llog_process_th.0 Request processed in 88us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969455.717905:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783969455.718266:0:17142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:451c11fa-8d33-493c-b495-458f5de7342a:17142:1870627099296768:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783969455.718297:0:17142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783969455.718623:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783969455.718645:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783969455.718659:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52600/0xea31253a47cbaca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbacaf expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.718670:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a52600/0xea31253a47cbaca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbacaf expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783969455.718714:0:17091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783969455.718717:0:17091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783969455.718718:0:17091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969455.718719:0:17091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969455.718720:0:17091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969455.718722:0:17091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969455.718723:0:17091:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783969455.718724:0:17091:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783969455.718726:0:17091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969455.718728:0:17091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783969455.718731:0:17091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783969455.718734:0:17091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783969455.718735:0:17091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783969455.718736:0:17091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969455.718741:0:17091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969455.718742:0:17091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969455.718743:0:17091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969455.718743:0:17091:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783969455.718744:0:17091:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783969455.718745:0:17091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969455.718746:0:17091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783969455.718761:0:17091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783969455.718772:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099296896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783969455.718806:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969455.718824:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84e48240 going to sleep for 11 seconds 00000100:00100000:2.0:1783969455.719658:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099296896 00000100:00100000:2.0:1783969455.719666:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099296896 00000100:00100000:2.0:1783969455.719702:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783969455.719710:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:17091:x1870627099296896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783969455.719736:0:17107:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783969455.719749:0:17107:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783969455.727370:0:17107:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783969455.727463:0:17107:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783969455.727790:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:17091:x1870627099296896:12345-0@lo:253:mount.lustre.0 Request processed in 8075us (8977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969455.727804:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:0.0:1783969455.727871:0:17128:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783969455.727876:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783969455.727895:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.727911:0:17128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbac8c expref: 11 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.727920:0:17128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.727959:0:17128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbac8c expref: 11 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.727973:0:17128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbac8c expref: 11 pid: 17106 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969455.727988:0:17128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099297024:0@lo:104: 00000100:00100000:0.0:1783969455.728025:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969455.728062:0:17128:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84e480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969455.728101:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099297024 00000100:00100000:0.0:1783969455.728109:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099297024 00000100:00100000:1.0:1783969455.728134:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17091:1870627099296896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783969455.728146:0:17091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783969455.728149:0:17091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783969455.728152:0:17091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783969455.728153:0:17091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969455.728160:0:17091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969455.728162:0:17091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969455.728163:0:17091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969455.728165:0:17091:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783969455.728166:0:17091:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783969455.728169:0:17091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969455.728171:0:17091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783969455.728185:0:17091:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783969455.728198:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969455.728221:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+3:17128:x1870627099297024:12345-0@lo:104: 00010000:00010000:0.0:1783969455.728233:0:17095:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.728275:0:17095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969455.728280:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+3:17128:x1870627099297024:12345-0@lo:104: Request processed in 61us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969455.728286:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783969455.728432:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969455.728439:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.728446:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafc00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969455.728450:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.728457:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969455.728464:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969455.728469:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783969455.728496:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.728512:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969455.728534:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.728542:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea83dafc00/0xea31253a47cbac8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbac93 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.728555:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969455.728557:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969455.728559:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969455.728582:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969455.728591:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099297152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969455.728620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969455.728801:0:17128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099297024:0@lo:104: 00010000:00010000:0.0:1783969455.728815:0:17128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969455.729148:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099297152 00000100:00100000:3.0:1783969455.729160:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099297152 00010000:00010000:3.0:1783969455.729183:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbac8c expref: 12 pid: 17106 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969455.729365:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969455.729373:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+12:3647:x1870627099297152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969455.730536:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969455.730550:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbac8c expref: 12 pid: 17106 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730564:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbac8c expref: 12 pid: 17106 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730581:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cde800/0xea31253a47cbac93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbac8c expref: 12 pid: 17106 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730598:0:17097:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730606:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783969455.730621:0:17097:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002745866s 00010000:00010000:3.0:1783969455.730626:0:17097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730633:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730641:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730657:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730664:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdf000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969455.730668:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730676:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730695:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.730705:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969455.730770:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+11:3647:x1870627099297152:12345-0@lo:103:ldlm_bl.0 Request processed in 1397us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969455.730780:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969455.730829:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099297152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969455.731336:0:17128:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.731346:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969455.731351:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdf000/0xea31253a47cbacc4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783969455.756716:0:17091:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1783969455.757263:0:17091:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783969455.757266:0:17152:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000040:01000000:2.0:1783969455.757490:0:17153:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783969455.757504:0:17091:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:0.0:1783969455.759052:0:17152:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1783969455.759577:0:17153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1783969455.760757:0:17154:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff93e983d22a00 x1870627099297280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969455.760772:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00000040:01000000:2.0:1783969455.761149:0:17091:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783969455.761193:0:17091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783969455.761991:0:17091:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783969455.762001:0:17091:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783969455.762050:0:17091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969455.763044:0:17091:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783969455.763610:0:17091:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783969455.763636:0:17091:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1783969455.765988:0:17091:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000040:00080000:0.0:1783969455.766780:0:17153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783969455.766848:0:17153:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:2.0:1783969455.770367:0:17091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1783969455.774930:0:17091:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783969455.775011:0:17091:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafc3c1c33988 00100000:10000000:3.0:1783969455.775020:0:17091:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783969455.775637:0:17091:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783969455.775650:0:17091:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783969455.775832:0:17091:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783969455.775846:0:17091:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783969455.777180:0:17091:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969455.777932:0:17091:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783969456.368533:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783969456.754179:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783969456.816478:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783969457.400783:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783969457.412594:0:17109:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783969457.412607:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93e98330a000 from 7 10000000:01000000:3.0:1783969457.412628:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783969457.412706:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969457.412720:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969457.412734:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969457.412770:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099297408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969457.412872:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969457.412933:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969457.421319:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099297408 00000100:00100000:2.0:1783969457.421338:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099297408 00000100:00100000:2.0:1783969457.421434:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783969457.421448:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+11:17109:x1870627099297408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969457.421471:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969457.421497:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbaccb expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969457.421544:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbaccb expref: 12 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969457.421558:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbaccb expref: 12 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969457.421570:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae200, rc 0) 00000100:00100000:2.0:1783969457.421812:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:17109:x1870627099297408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 367us (8938us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969457.421821:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969457.425074:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099297408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969457.425128:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969457.425146:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969457.425271:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099297536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783969457.425363:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969457.425434:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da4180 going to sleep for 11 seconds 00000100:00100000:3.0:1783969457.425710:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099297536 00000100:00100000:3.0:1783969457.425719:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099297536 00000100:00100000:3.0:1783969457.425794:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783969457.425806:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:17109:x1870627099297536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783969457.425832:0:17107:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783969457.425853:0:17107:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783969457.425856:0:17107:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783969457.425967:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:17109:x1870627099297536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969457.425976:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783969457.426030:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099297536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783969457.426080:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969457.426089:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969457.426099:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969457.778675:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783969457.842602:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783969458.416637:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969458.870549:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783969459.451823:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969459.891152:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783969460.466557:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969460.913535:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00000100:00100000:1.0:1783969461.105688:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1783969461.105815:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783969461.105821:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783969461.105824:0:36:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783969461.105832:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:2.0:1783969461.105837:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783969461.105845:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93eab6109800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969461.105922:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d21180 x1870627099297792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969461.105945:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969461.105948:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969461.105951:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969461.105954:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969461.105956:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783969461.105959:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783969461.105961:0:36:0:(import.c:65:import_set_state_nolock()) ffff93e9837e4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969461.105966:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93e9837e4800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969461.105978:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d20a80 x1870627099297920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969461.107258:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099297792:0@lo:38:kworker.0 00000100:00100000:2.0:1783969461.107394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969461.107445:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099297920:0@lo:38:kworker.0 00000100:00100000:2.0:1783969461.107471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969461.108835:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099297664:0@lo:400:kworker.0 00000100:00100000:1.0:1783969461.108894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969461.108955:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099297664 00000100:00100000:1.0:1783969461.108962:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099297664 00000100:00100000:1.0:1783969461.109011:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969461.109020:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+12:3646:x1870627099297664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969461.109073:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+12:3646:x1870627099297664:12345-0@lo:400:kworker.0 Request processed in 53us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969461.109081:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969461.109145:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099297664:0@lo:400:kworker.0 00000100:00100000:0.0:1783969461.109593:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099297792 00000100:00100000:0.0:1783969461.109600:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099297792 00000100:00100000:1.0:1783969461.109605:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099297920 00000100:00100000:1.0:1783969461.109609:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099297920 00000100:00100000:0.0:1783969461.109631:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969461.109635:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969461.109637:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1870627099297792:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783969461.109639:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1870627099297920:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783969461.109653:0:17118:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1783969461.109815:0:17114:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1783969461.109852:0:17114:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xea31253a47cbacd9 00000004:00100000:1.0:1783969461.109868:0:17114:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783969461.110139:0:17114:0:(import.c:65:import_set_state_nolock()) ffff93eab72a0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969461.110408:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870627099297920:12345-0@lo:38:kworker.0 Request processed in 618us (2786us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969461.110419:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783969461.110897:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93e983d20a80 x1870627099297920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783969461.110915:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783969461.110948:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783969461.110954:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783969461.110958:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e9837e4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783969461.110964:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870627099297920:0@lo:38:kworker.0 00000100:00100000:2.0:1783969461.144084:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1870627099297792:12345-0@lo:38:kworker.0 Request processed in 34437us (36696us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783969461.144104:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783969461.144181:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783969461.144186:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783969461.144190:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099297792:0@lo:38:kworker.0 00000001:02000400:3.0:1783969461.317708:0:17397:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783969461.490867:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969461.937538:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00000020:00000004:0.0:1783969462.486638:0:17449:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783969462.486882:0:17449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783969462.517580:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969462.960550:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00000020:00000004:1.0:1783969463.499650:0:17499:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969463.500041:0:17499:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783969463.537072:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969463.984512:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783969464.560849:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969465.009638:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00000100:00100000:0.0:1783969465.201431:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969455/real 1783969455] req@ffff93e98319d180 x1870627099294848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969465 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969465.201484:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93e98319d180 x1870627099294848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969465 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969465.201495:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969455/real 1783969455] req@ffff93e983d23b80 x1870627099294720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969465 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969465.201531:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93e983d23b80 x1870627099294720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969465 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783969465.201551:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783969465.201581:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783969465.201585:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099294848:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783969465.201591:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea88952800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783969465.201596:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783969465.201598:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099294720:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783969465.201813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783969465.201819:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783969465.201822:0:8:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969465.201827:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1783969465.201832:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783969465.201838:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93eab6109800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969465.201860:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea867b0000 x1870627099298176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783969465.201877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969465.201880:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783969465.201882:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ea88952800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969465.201886:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:1.0:1783969465.201889:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783969465.201893:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ea88952800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969465.201903:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea867b3480 x1870627099298304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783969465.201911:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969465.201914:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783969465.201916:0:8:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969465.201926:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:1.0:1783969465.201929:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783969465.201933:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93eab9286000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969465.201944:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea867b0e00 x1870627099298432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783969465.202102:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099298560:0@lo:400:kworker.0 00000100:00100000:3.0:1783969465.202200:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969465.202275:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969465.202281:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:451c11fa-8d33-493c-b495-458f5de7342a:3649:1870627099298048:0@lo:400:kworker.0 00000100:00100000:3.0:1783969465.202311:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969465.202348:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099298048 00000100:00100000:3.0:1783969465.202354:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099298048 00000100:00100000:3.0:1783969465.202428:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969465.202437:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:3649:x1870627099298048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969465.202485:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:3649:x1870627099298048:12345-0@lo:400:kworker.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969465.202493:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969465.202541:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:451c11fa-8d33-493c-b495-458f5de7342a:3649:1870627099298048:0@lo:400:kworker.0 00000100:00100000:1.0:1783969465.202752:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099298560 00000100:00100000:1.0:1783969465.202756:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099298560 00000100:00100000:1.0:1783969465.202793:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969465.202801:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099298560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969465.202840:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099298560:12345-0@lo:400:kworker.0 Request processed in 41us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969465.202846:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783969465.202922:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ea867b3100 x1870627099298560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969465.202934:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099298560:0@lo:400:kworker.0 00000100:00100000:0.0:1783969465.203283:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099298176:0@lo:38:kworker.0 00000100:00100000:0.0:1783969465.203318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969465.203586:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099298304:0@lo:8:kworker.0 00000400:00000100:0.0:1783969465.203610:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099298304 offset 0 length 520: 4 00000100:00100000:0.0:1783969465.203627:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099298432:0@lo:8:kworker.0 00000400:00000100:0.0:1783969465.203641:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099298432 offset 0 length 520: 4 00000100:00100000:3.0:1783969465.207487:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099298176 00000100:00100000:3.0:1783969465.207502:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099298176 00000100:00100000:3.0:1783969465.207561:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969465.207569:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099298176:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783969465.207590:0:17117:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783969465.241771:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099298176:12345-0@lo:38:kworker.0 Request processed in 34192us (38441us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783969465.241788:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783969465.242587:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783969465.242595:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783969465.242599:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099298176:0@lo:38:kworker.0 00010000:00010000:2.0:1783969465.584584:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969466.036762:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783969466.614637:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969467.057477:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783969467.633893:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783969468.024048:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783969468.080508:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783969468.656586:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969469.106119:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783969469.680625:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969470.128553:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00000100:00080000:0.0:1783969470.320808:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783969470.320815:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783969470.320819:0:38:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783969470.320827:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:0.0:1783969470.320833:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783969470.320845:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93eab6109800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969470.320869:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf746d80 x1870627099298816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783969470.320881:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969470.320884:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783969470.320887:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969470.320890:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783969470.320920:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099298688:0@lo:400:kworker.0 00000100:00100000:0.0:1783969470.320996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969470.321044:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969470.321051:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099298944:0@lo:400:kworker.0 00000100:00100000:0.0:1783969470.321079:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969470.321113:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099298688 00000100:00100000:0.0:1783969470.321120:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099298688 00000100:00100000:0.0:1783969470.321161:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783969470.321169:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:3646:x1870627099298688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969470.321214:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:3646:x1870627099298688:12345-0@lo:400:kworker.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969470.321222:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783969470.321252:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099298944 00000100:00100000:0.0:1783969470.321256:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099298944 00000100:00100000:0.0:1783969470.321280:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969470.321286:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099298944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969470.321317:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099298944:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969470.321332:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783969470.321369:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93eabf745c00 x1870627099298944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969470.321400:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099298944:0@lo:400:kworker.0 00000100:00100000:0.0:1783969470.321411:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099298688:0@lo:400:kworker.0 00000100:00100000:3.0:1783969470.321503:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099298816:0@lo:38:kworker.0 00000100:00100000:3.0:1783969470.321602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969470.321902:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099298816 00000100:00100000:0.0:1783969470.321907:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099298816 00000100:00100000:0.0:1783969470.321978:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969470.321984:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1870627099298816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783969470.322001:0:17118:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783969470.350228:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1870627099298816:12345-0@lo:38:kworker.0 Request processed in 28235us (28617us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783969470.350242:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783969470.357181:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783969470.357195:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783969470.357200:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099298816:0@lo:38:kworker.0 00010000:00010000:1.0:1783969470.705848:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969471.152467:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00000020:01000004:1.0:1783969471.490143:0:17845:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783969471.490148:0:17845:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783969471.490149:0:17845:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783969471.490261:0:17845:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93e9835eb000 00000020:01000004:1.0:1783969471.490277:0:17845:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1783969471.490289:0:17845:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783969471.490303:0:17845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff93eab7558000) 00000020:00000080:1.0:1783969471.490319:0:17845:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783969471.560173:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1783969471.566528:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783969471.576672:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783969471.584243:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.585887:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.588051:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.588662:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.588954:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.589987:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.590767:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.592139:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.593086:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.593790:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.594711:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.595060:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.595438:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.595697:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.595988:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.598311:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.599175:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.599578:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.600002:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.600290:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.600692:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.602464:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.602975:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.604001:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.605837:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.606276:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.606606:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.606877:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.607155:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783969471.608934:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.609447:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783969471.618582:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783969471.621924:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1783969471.622332:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783969471.623132:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783969471.624354:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783969471.625015:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783969471.625426:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783969471.626766:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783969471.627700:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1783969471.628082:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783969471.628296:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783969471.628703:0:17845:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:01000000:2.0:1783969471.633972:0:17845:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783969471.634230:0:17845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1783969471.634246:0:17845:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783969471.634272:0:17845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cbace7 00000020:01000004:2.0:1783969471.634281:0:17845:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783969471.634306:0:17845:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783969471.634309:0:17845:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783969471.634316:0:17845:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1783969471.634346:0:17845:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1783969471.634351:0:17845:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1783969471.652783:0:17845:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783969471.652838:0:17845:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1783969471.652844:0:17845:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783969471.652846:0:17845:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783969471.652847:0:17845:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969471.652848:0:17845:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969471.652850:0:17845:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969471.652851:0:17845:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969471.652852:0:17845:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783969471.652872:0:17845:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969471.652873:0:17845:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783969471.652877:0:17845:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1783969471.652879:0:17845:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783969471.652881:0:17845:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783969471.652882:0:17845:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969471.652883:0:17845:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969471.652884:0:17845:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969471.652885:0:17845:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969471.652886:0:17845:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783969471.652887:0:17845:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969471.652888:0:17845:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783969471.652918:0:17845:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783969471.652940:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783969471.653026:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969471.653092:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510840 going to sleep for 11 seconds 00000100:00100000:1.0:1783969471.653275:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099299072 00000100:00100000:1.0:1783969471.653283:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099299072 00000100:00100000:1.0:1783969471.653348:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783969471.653366:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+12:17845:x1870627099299072:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783969471.653451:0:17105:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783969471.653454:0:17105:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1783969471.653462:0:17105:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783969471.654220:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+12:17845:x1870627099299072:12345-0@lo:253:mount.lustre.0 Request processed in 852us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969471.654232:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783969471.654402:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783969471.654416:0:17845:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783969471.654418:0:17845:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969471.654420:0:17845:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783969471.654421:0:17845:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969471.654422:0:17845:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969471.654423:0:17845:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969471.654424:0:17845:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969471.654425:0:17845:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969471.654426:0:17845:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969471.654427:0:17845:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783969471.654446:0:17845:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93e9835eb000 from lustre-MDT0001 10000000:01000000:2.0:1783969471.654479:0:17845:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1783969471.654489:0:17845:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783969471.654496:0:17845:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93eab71619c0 local copy 00010000:00010000:2.0:1783969471.654506:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969471.654623:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969471.654657:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969471.654689:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969471.654807:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099299200 00000100:00100000:3.0:1783969471.654812:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099299200 00000100:00100000:3.0:1783969471.654853:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969471.654862:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:17845:x1870627099299200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969471.654993:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+12:17845:x1870627099299200:12345-0@lo:501:mount.lustre.0 Request processed in 131us (333us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783969471.655000:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783969471.655184:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299200:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783969471.655199:0:17845:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783969471.655218:0:17845:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783969471.655224:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.655232:0:17845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969471.655256:0:17845:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93e9835eb000 10000000:01000000:2.0:1783969471.655270:0:17845:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783969471.655276:0:17845:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93eab71619c0 10000000:01000000:2.0:1783969471.655278:0:17845:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783969471.655282:0:17845:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff93eab71619c0 from 1 10000000:01000000:2.0:1783969471.655284:0:17845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783969471.655309:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daee00/0xea31253a47cbacee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.655316:0:17845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea83daee00/0xea31253a47cbacee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.655337:0:17845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea83daee00/0xea31253a47cbacee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969471.655349:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969471.655375:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969471.655426:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969471.655573:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099299328 00000100:00100000:0.0:1783969471.655578:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099299328 00000100:00100000:0.0:1783969471.655604:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783969471.655612:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+12:17845:x1870627099299328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969471.655622:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969471.655638:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cde600/0xea31253a47cbacf5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbacee expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.655662:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cde600/0xea31253a47cbacf5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbacee expref: 13 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.655672:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cde600/0xea31253a47cbacf5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbacee expref: 13 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.655681:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde600, rc 0) 00000100:00100000:0.0:1783969471.655712:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+13:17845:x1870627099299328:12345-0@lo:101:mount.lustre.0 Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969471.655726:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783969471.656028:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969471.656051:0:17845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea83daee00/0xea31253a47cbacee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbacf5 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.656059:0:17845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea83daee00/0xea31253a47cbacee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbacf5 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969471.656075:0:17845:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783969471.656091:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daee00/0xea31253a47cbacee lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbacf5 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.656098:0:17845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83daee00/0xea31253a47cbacee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbacf5 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969471.656105:0:17845:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93e9835eb000 10000000:01000000:2.0:1783969471.656110:0:17845:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783969471.656113:0:17845:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff93e9835eb000 from 1 10000000:01000000:2.0:1783969471.656116:0:17845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783969471.656132:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daec00/0xea31253a47cbacfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.656139:0:17845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea83daec00/0xea31253a47cbacfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.656152:0:17845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea83daec00/0xea31253a47cbacfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969471.656165:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969471.656193:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969471.656221:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969471.656460:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099299456 00000100:00100000:0.0:1783969471.656465:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099299456 00000100:00100000:0.0:1783969471.656495:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783969471.656501:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+13:17845:x1870627099299456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969471.656509:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969471.656517:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdf600/0xea31253a47cbad03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbacfc expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.656531:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdf600/0xea31253a47cbad03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbacfc expref: 14 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.656538:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdf600/0xea31253a47cbad03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbacfc expref: 14 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.656545:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdf600, rc 0) 00000100:00100000:0.0:1783969471.656673:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+14:17845:x1870627099299456:12345-0@lo:101:mount.lustre.0 Request processed in 171us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969471.656679:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783969471.657001:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969471.657013:0:17845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea83daec00/0xea31253a47cbacfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbad03 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.657021:0:17845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea83daec00/0xea31253a47cbacfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbad03 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969471.657094:0:17845:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783969471.657110:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daec00/0xea31253a47cbacfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbad03 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.657116:0:17845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83daec00/0xea31253a47cbacfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbad03 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969471.657121:0:17845:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783969471.657125:0:17845:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783969471.657130:0:17845:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93e9835eb000 10000000:01000000:2.0:1783969471.657132:0:17845:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783969471.657135:0:17845:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1783969471.657137:0:17845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783969471.657152:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf400/0xea31253a47cbad0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.657166:0:17845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea83daf400/0xea31253a47cbad0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.657174:0:17845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea83daf400/0xea31253a47cbad0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969471.657188:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969471.657220:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969471.657250:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969471.657727:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099299584 00000100:00100000:0.0:1783969471.657733:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099299584 00000100:00100000:0.0:1783969471.657765:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783969471.657773:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+14:17845:x1870627099299584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969471.657784:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969471.657795:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdea00/0xea31253a47cbad11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbad0a expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.657812:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdea00/0xea31253a47cbad11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbad0a expref: 15 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.657828:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdea00/0xea31253a47cbad11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbad0a expref: 15 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.657836:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdea00, rc 0) 00000100:00100000:0.0:1783969471.658221:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099299584:12345-0@lo:101:mount.lustre.0 Request processed in 447us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969471.658228:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783969471.658425:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969471.658439:0:17845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea83daf400/0xea31253a47cbad0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbad11 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.658447:0:17845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea83daf400/0xea31253a47cbad0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbad11 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969471.669073:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1783969471.670529:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969471.683101:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783969471.683163:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1783969471.683179:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1783969471.683192:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1783969471.683205:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1783969471.683218:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1783969471.683233:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1783969471.683246:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1783969471.683259:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1783969471.683272:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1783969471.683289:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1783969471.683305:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1783969471.683322:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1783969471.683335:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1783969471.683350:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1783969471.683363:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1783969471.683375:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1783969471.683420:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1783969471.683433:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1783969471.683444:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1783969471.683456:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1783969471.683480:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1783969471.683495:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1783969471.683524:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1783969471.683529:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1783969471.683843:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969471.684000:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969471.684106:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84e48900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969471.686126:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099299712 00000100:00100000:1.0:1783969471.686145:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099299712 00000100:00100000:1.0:1783969471.686280:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783969471.686292:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099299712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969471.686515:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099299712:12345-0@lo:501:mount.lustre.0 Request processed in 224us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969471.686525:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783969471.686649:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969471.686704:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969471.686768:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969471.699740:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099299840 00000100:00100000:0.0:1783969471.699756:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099299840 00000100:00100000:2.0:1783969471.699819:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969471.699833:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783969471.699844:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099299840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969471.701140:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969471.701354:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099299840:12345-0@lo:503:mount.lustre.0 Request processed in 1190us (14264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969471.701363:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000040:00080000:2.0:1783969471.707115:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783969471.707257:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969471.710984:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969471.711279:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94510840 going to sleep for 11 seconds 00000100:00100000:1.0:1783969471.712284:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099299968 00000100:00100000:1.0:1783969471.712298:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099299968 00000100:00100000:0.0:1783969471.721630:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969471.721773:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099299968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969471.722845:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099299968:12345-0@lo:502:mount.lustre.0 Request processed in 1197us (14976us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.722880:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783969471.723430:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099299968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969471.724368:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783969471.724860:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1783969471.725044:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1783969471.725064:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1783969471.725079:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1783969471.725093:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1783969471.725107:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1783969471.725120:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1783969471.725133:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1783969471.725145:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1783969471.725159:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1783969471.725176:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1783969471.725190:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1783969471.725236:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1783969471.725251:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1783969471.725279:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1783969471.725296:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1783969471.725310:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1783969471.725324:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1783969471.725338:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1783969471.725351:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1783969471.725364:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1783969471.725410:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1783969471.725430:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1783969471.725445:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1783969471.725458:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1783969471.725470:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1783969471.725482:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1783969471.725494:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1783969471.725505:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1783969471.725518:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1783969471.725530:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1783969471.725541:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1783969471.725552:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1783969471.726954:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1783969471.726999:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1783969471.727015:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1783969471.727164:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1783969471.727187:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1783969471.727198:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1783969471.727210:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1783969471.727222:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1783969471.727234:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1783969471.727247:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1783969471.727323:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099300096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969471.727486:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969471.729240:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969471.739797:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84e48b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969471.739924:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099300096 00000100:00100000:2.0:1783969471.739936:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099300096 00000100:00100000:2.0:1783969471.740005:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783969471.740017:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099300096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969471.740211:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099300096:12345-0@lo:502:mount.lustre.0 Request processed in 195us (12725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.740221:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783969471.742124:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099300096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969471.742237:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1783969471.742253:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1783969471.743951:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969471.743966:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.743968:0:17849:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783969471.743975:0:17849:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1783969471.743978:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969471.743994:0:17849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff93eab7164d40) 00000020:00000080:0.0:1783969471.744021:0:17849:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1783969471.744028:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783969471.744184:0:17849:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783969471.744193:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cbad1f 00000020:00000080:0.0:1783969471.744491:0:17849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783969471.744496:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969471.744500:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.744501:0:17849:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783969471.744504:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969471.744508:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.744509:0:17849:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1783969471.744512:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969471.744519:0:17849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff93eab7160000) 00000020:00000080:0.0:1783969471.744531:0:17849:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1783969471.744534:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783969471.744536:0:17849:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1783969471.744539:0:17849:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1783969471.744544:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783969471.745724:0:17849:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93e9835eb000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783969471.745746:0:17849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93eab920cd40) 00000020:00000080:0.0:1783969471.745771:0:17849:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1783969471.745832:0:17849:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783969471.745839:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cbad34 00000020:00000080:0.0:1783969471.750456:0:17849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1783969471.750482:0:17849:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783969471.750497:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xea31253a47cbad3b 00080000:01000000:0.0:1783969471.750506:0:17849:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783969471.750511:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cbad42 00010000:00010000:2.0:1783969471.903195:0:17849:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1783969471.905070:0:17849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1783969471.906039:0:17849:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783969471.910863:0:17849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1783969471.910881:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969471.910889:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969471.910891:0:17849:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1783969471.910895:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969471.910901:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969471.910902:0:17849:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1783969471.910905:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783969471.910910:0:17849:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:00000080:1.0:1783969471.910956:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783969471.910973:0:17849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff93eab612cd40) 00000020:00000080:1.0:1783969471.910997:0:17849:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1783969471.911001:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783969471.911096:0:17849:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1783969471.911104:0:17849:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783969471.911111:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cbad50 00010000:00080000:1.0:1783969471.911146:0:17849:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93e982780800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1783969471.914473:0:17849:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1783969471.915585:0:17849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783969471.915600:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783969471.915639:0:17849:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783969471.915739:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cbad57 00000100:00080000:0.0:1783969471.915751:0:17849:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969471.915755:0:17849:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93e982780800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969471.915791:0:17849:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf745c00 x1870627099300224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969471.915859:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099300224:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783969471.915932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783969471.916014:0:17849:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1783969471.916070:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969471.916074:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.916076:0:17849:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1783969471.916079:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783969471.916082:0:17849:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783969471.916083:0:17849:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969471.916085:0:17849:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969471.916086:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783969471.916089:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.916090:0:17849:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783969471.916092:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969471.916097:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.916098:0:17849:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1783969471.916102:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783969471.916136:0:17849:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783969471.916166:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969471.916170:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.916171:0:17849:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1783969471.916174:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783969471.916176:0:17849:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1783969471.916177:0:17849:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969471.916178:0:17849:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:3.0:1783969471.916239:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099300224 00000100:00100000:3.0:1783969471.916248:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099300224 00000100:00100000:3.0:1783969471.916280:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969471.916288:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1870627099300224:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783969471.916318:0:17117:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1783969471.916351:0:17117:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cbad5e 00000004:00100000:3.0:1783969471.916365:0:17117:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783969471.916371:0:17117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1783969471.916605:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783969471.916609:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783969471.916618:0:8:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969471.916623:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:3.0:1783969471.916630:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00100000:2.0:1783969471.916737:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099300352:0@lo:400:kworker.0 00000100:00100000:2.0:1783969471.916923:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969471.916977:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099300352 00000100:00100000:2.0:1783969471.916981:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099300352 00000100:00100000:2.0:1783969471.917014:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783969471.917021:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+15:3648:x1870627099300352:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783969471.917101:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93eab6109800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969471.917121:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e983d20a80 x1870627099300480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969471.917298:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+15:3648:x1870627099300352:12345-0@lo:400:kworker.0 Request processed in 277us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.917306:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783969471.917355:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099300352:0@lo:400:kworker.0 00000100:00100000:1.0:1783969471.918110:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099300480:0@lo:38:kworker.0 00000100:00100000:1.0:1783969471.918167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783969471.918306:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783969471.918312:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.918314:0:17849:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783969471.918319:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783969471.918323:0:17849:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783969471.918326:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.918327:0:17849:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783969471.918330:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783969471.918334:0:17849:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:0.0:1783969471.918357:0:17849:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783969471.918360:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969471.918376:0:17849:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93eab92099c0) 00000020:00000080:0.0:1783969471.918411:0:17849:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1783969471.918417:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783969471.918509:0:17849:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1783969471.918516:0:17849:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783969471.918523:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cbad6c 00010000:00080000:0.0:1783969471.918555:0:17849:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93e9835e9000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969471.921524:0:17849:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1783969471.921649:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969471.921658:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969471.921661:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969471.921664:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783969471.921750:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1783969471.921761:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1783969471.921791:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969471.921810:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099300608:0@lo:400:kworker.0 00000100:00100000:3.0:1783969471.922268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969471.922462:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099300608 00000100:00100000:0.0:1783969471.922471:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099300608 00000100:00100000:0.0:1783969471.922524:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969471.922534:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099300608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969471.922594:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099300608:12345-0@lo:400:kworker.0 Request processed in 61us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969471.922609:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:1.0:1783969471.923251:0:17849:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783969471.923530:0:17849:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00010000:00080000:3.0:1783969471.923964:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93e983d21f80 x1870627099300608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969471.924003:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099300608:0@lo:400:kworker.0 00000100:00100000:0.0:1783969471.924222:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099300480 00000100:00100000:0.0:1783969471.924230:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099300480 00000100:00100000:3.0:1783969471.924320:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969471.924326:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1870627099300480:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783969471.924480:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1870627099300480:12345-0@lo:38:kworker.0 Request processed in 151us (6312us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783969471.924488:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969471.924504:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969471.924512:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783969471.924516:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783969471.924519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099300480:0@lo:38:kworker.0 00000100:00080000:2.0:1783969471.927632:0:17117:0:(import.c:65:import_set_state_nolock()) ffff93eab90cb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969471.927751:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1870627099300224:12345-0@lo:38:llog_process_th.0 Request processed in 11460us (11817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.927764:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969471.928077:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783969471.928087:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783969471.928105:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783969471.928110:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783969471.928113:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e982780800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783969471.928133:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099300224:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969471.928339:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099300736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969471.928460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969471.928577:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099300736 00000100:00100000:0.0:1783969471.928585:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099300736 00000100:00100000:0.0:1783969471.928634:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969471.928644:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1870627099300736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969471.928672:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783969471.928751:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1870627099300736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969471.928758:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969471.929039:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099300736:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1783969471.932747:0:17849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969471.932969:0:17849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1783969471.933249:0:17849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1783969471.935839:0:17855:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783969471.935846:0:17855:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783969471.937961:0:17849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783969471.937977:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783969471.938355:0:17849:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783969471.938377:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cbad73 00000100:00080000:0.0:1783969471.938406:0:17849:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969471.938412:0:17849:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93e9835e9000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969471.938444:0:17849:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf745500 x1870627099300864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783969471.938780:0:17849:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783969471.938913:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969471.938918:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969471.938921:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969471.938924:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783969471.938935:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099300864:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783969471.939015:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099300864 offset 0 length 520: 4 00000020:01000000:0.0:1783969471.939102:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969471.939107:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.939109:0:17849:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783969471.939111:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783969471.939114:0:17849:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1783969471.939116:0:17849:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969471.939117:0:17849:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969471.939119:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783969471.939121:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.939122:0:17849:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783969471.939125:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783969471.939128:0:17849:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783969471.939131:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.939132:0:17849:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783969471.939135:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783969471.939138:0:17849:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:0.0:1783969471.939156:0:17849:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783969471.939158:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969471.939170:0:17849:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93eab920b380) 00000020:00000080:0.0:1783969471.939185:0:17849:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1783969471.939190:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783969471.939788:0:17849:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1783969471.939795:0:17849:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783969471.939802:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xea31253a47cbad81 00010000:00080000:0.0:1783969471.939841:0:17849:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ea8325a800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969471.940580:0:17849:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1783969471.941082:0:17849:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783969471.941099:0:17849:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1783969471.947643:0:17849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969471.948145:0:17849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1783969471.948360:0:17849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1783969471.949371:0:17857:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783969471.949378:0:17857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783969471.951351:0:17849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783969471.951367:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783969471.951594:0:17849:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783969471.951624:0:17849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cbad88 00000100:00080000:0.0:1783969471.951928:0:17849:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969471.951937:0:17849:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93ea8325a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969471.951989:0:17849:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf744700 x1870627099300992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783969471.952137:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099300992:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783969471.952196:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099300992 offset 0 length 520: 4 00000100:00080000:0.0:1783969471.952324:0:17849:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783969471.952418:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969471.952423:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.952425:0:17849:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783969471.952428:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969471.952432:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.952433:0:17849:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783969471.952436:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969471.952438:0:17849:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783969471.952440:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969471.952442:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.952443:0:17849:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783969471.952445:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969471.952447:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.952449:0:17849:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783969471.952463:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783969471.952492:0:17849:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969471.952496:0:17849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969471.952497:0:17849:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783969471.952500:0:17849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1783969471.952932:0:17845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1783969471.952972:0:17845:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783969471.952997:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf400/0xea31253a47cbad0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbad11 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.953007:0:17845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83daf400/0xea31253a47cbad0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbad11 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969471.953015:0:17845:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93e9835eb000 from 1 10000000:01000000:2.0:1783969471.953018:0:17845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00080000:1.0:1783969471.953125:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969471.953130:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969471.953133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969471.953136:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1783969471.953337:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.953346:0:17845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969471.953358:0:17845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969471.953376:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969471.953462:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969471.953489:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969471.954014:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099301120 00000100:00100000:0.0:1783969471.954023:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099301120 00000100:00100000:0.0:1783969471.954084:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783969471.954106:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+15:17845:x1870627099301120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969471.954120:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969471.954133:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbad8f expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.954157:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbad8f expref: 16 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.954167:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbad8f expref: 16 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969471.954174:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cdec00, rc 0) 00000100:00100000:0.0:1783969471.954233:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+16:17845:x1870627099301120:12345-0@lo:101:mount.lustre.0 Request processed in 128us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969471.954240:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969471.954613:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969471.954630:0:17845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969471.954651:0:17845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969471.955340:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301248:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783969471.955764:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969471.955850:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969471.956233:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099301248 00000100:00100000:2.0:1783969471.956306:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099301248 00000100:00100000:2.0:1783969471.956422:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783969471.956432:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+16:17845:x1870627099301248:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783969471.956464:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783969471.956482:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783969471.956485:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1783969471.956594:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+16:17845:x1870627099301248:12345-0@lo:256:mount.lustre.0 Request processed in 164us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.956601:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969471.956691:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301248:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783969471.957309:0:17845:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969471.957482:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969471.957494:0:17845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969471.957516:0:17845:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e9835eb000 from 1 10000000:01000000:3.0:1783969471.957519:0:17845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969471.957548:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969471.957556:0:17845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969471.957566:0:17845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969471.957586:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783969471.957628:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969471.958741:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969471.958956:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099301376 00000100:00100000:0.0:1783969471.958964:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099301376 00000100:00100000:1.0:1783969471.959313:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969471.959325:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+16:17845:x1870627099301376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969471.959341:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969471.959359:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbad9d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.959429:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbad9d expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.959441:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbad9d expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.959559:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6600, rc 0) 00000100:00100000:1.0:1783969471.959622:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099301376:12345-0@lo:101:mount.lustre.0 Request processed in 300us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969471.959629:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783969471.959848:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969471.959867:0:17845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969471.959876:0:17845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969471.960070:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969471.960112:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969471.960145:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969471.960830:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969471.960967:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099301504 00000100:00100000:2.0:1783969471.960973:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099301504 00000100:00100000:2.0:1783969471.961120:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783969471.961130:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099301504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969471.961557:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099301504:12345-0@lo:501:mount.lustre.0 Request processed in 429us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.961566:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783969471.961971:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969471.962037:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969471.962095:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969471.962117:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969471.962354:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099301632 00000100:00100000:2.0:1783969471.962360:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099301632 00000100:00100000:2.0:1783969471.962407:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783969471.962415:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099301632:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969471.962528:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099301632:12345-0@lo:503:mount.lustre.0 Request processed in 113us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.962534:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783969471.962801:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301632:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783969471.963627:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969471.963800:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969471.963919:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969471.963961:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969471.964212:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099301760 00000100:00100000:2.0:1783969471.964218:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099301760 00000100:00100000:2.0:1783969471.964320:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783969471.964330:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099301760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969471.964545:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099301760:12345-0@lo:502:mount.lustre.0 Request processed in 216us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.964559:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783969471.964966:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783969471.965444:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783969471.965567:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1783969471.965586:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1783969471.965600:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1783969471.965613:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1783969471.965626:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1783969471.965653:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1783969471.965667:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1783969471.965680:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783969471.965693:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1783969471.965899:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1783969471.965934:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969471.966135:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969471.966180:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969471.966921:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099301888 00000100:00100000:2.0:1783969471.966930:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099301888 00000100:00100000:2.0:1783969471.967004:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783969471.967014:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099301888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969471.967213:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099301888:12345-0@lo:502:mount.lustre.0 Request processed in 200us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.967221:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783969471.967588:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099301888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783969471.967808:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1783969471.967891:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783969471.969598:0:17859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969471.969611:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969471.969621:0:17859:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783969471.969629:0:17859:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93e9835eb000 00000020:00000080:3.0:1783969471.969911:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783969471.969924:0:17859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969471.969928:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969471.969929:0:17859:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783969471.969932:0:17859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969471.969934:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969471.969936:0:17859:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783969471.969950:0:17859:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93e9835eb000 00000020:00000080:3.0:1783969471.969953:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783969471.970155:0:17859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969471.970160:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969471.970162:0:17859:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783969471.970164:0:17859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969471.970167:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969471.970169:0:17859:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783969471.970172:0:17859:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93e9835eb000 00000020:00000080:3.0:1783969471.970174:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783969471.970192:0:17859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969471.970195:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969471.970196:0:17859:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783969471.970198:0:17859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969471.970200:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969471.970202:0:17859:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783969471.970205:0:17859:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93e9835eb000 00000020:00000080:3.0:1783969471.970207:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783969471.970231:0:17859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969471.970235:0:17859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969471.970236:0:17859:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783969471.970239:0:17859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1783969471.972141:0:17845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783969471.972186:0:17845:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969471.972211:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.972225:0:17845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969471.972304:0:17845:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783969471.972309:0:17845:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93e9835eb000 10000000:01000000:1.0:1783969471.972312:0:17845:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93e9835eb000 10000000:01000000:1.0:1783969471.972316:0:17845:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783969471.972323:0:17845:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93e9835eb000 from 1 10000000:01000000:1.0:1783969471.972326:0:17845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783969471.972365:0:17845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983de7600/0xea31253a47cbadab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.972374:0:17845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e983de7600/0xea31253a47cbadab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.972419:0:17845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e983de7600/0xea31253a47cbadab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969471.972448:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783969471.972655:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969471.972709:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099302016 00000100:00100000:1.0:1783969471.972716:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099302016 00000100:00100000:1.0:1783969471.972763:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783969471.972771:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17845:x1870627099302016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969471.972785:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969471.972800:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983de6a00/0xea31253a47cbadb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbadab expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.973106:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de6a00/0xea31253a47cbadb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbadab expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.973119:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983de6a00/0xea31253a47cbadb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbadab expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.973129:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6a00, rc 0) 00000100:00100000:1.0:1783969471.973165:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302016:12345-0@lo:101:mount.lustre.0 Request processed in 394us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969471.973171:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783969471.973221:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969471.973310:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969471.973326:0:17845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e983de7600/0xea31253a47cbadab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbadb2 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969471.973342:0:17845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e983de7600/0xea31253a47cbadab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbadb2 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783969471.977795:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1783969471.978321:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969471.980022:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1783969471.980606:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1783969471.980620:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1783969471.980766:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1783969471.980785:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1783969471.980797:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1783969471.980810:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1783969471.981344:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1783969471.981363:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1783969471.981375:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1783969471.981416:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1783969471.981430:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1783969471.981444:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1783969471.981536:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1783969471.981576:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1783969471.981593:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1783969471.981608:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1783969471.981621:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1783969471.981630:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1783969471.983445:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1783969471.983784:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1783969471.983800:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1783969471.983812:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1783969471.983901:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1783969471.983914:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1783969471.983928:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1783969471.983969:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1783969471.983981:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1783969471.984142:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1783969471.984149:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1783969471.984566:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969471.985551:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969471.985605:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969471.985915:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099302144 00000100:00100000:2.0:1783969471.985925:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099302144 00000100:00100000:2.0:1783969471.986005:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783969471.986017:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969471.986170:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302144:12345-0@lo:501:mount.lustre.0 Request processed in 156us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969471.986178:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783969471.986977:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969471.987420:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969471.987925:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969471.987971:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969471.988162:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099302272 00000100:00100000:0.0:1783969471.988170:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099302272 00000100:00100000:0.0:1783969471.988214:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783969471.988222:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969471.989142:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969471.990008:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302272:12345-0@lo:503:mount.lustre.0 Request processed in 802us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969471.990021:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000040:00080000:1.0:1783969471.996432:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783969471.997046:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969471.997129:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969471.997193:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099302400 00000100:00100000:1.0:1783969471.997201:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099302400 00000100:00100000:1.0:1783969471.997264:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783969471.997272:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969471.997431:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302400:12345-0@lo:502:mount.lustre.0 Request processed in 158us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969471.997439:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783969472.000598:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5d80 going to sleep for 10 seconds 00000100:00100000:1.0:1783969472.001724:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783969472.003170:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1783969472.003230:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1783969472.005054:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1783969472.005096:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1783969472.005110:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1783969472.005121:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1783969472.005135:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1783969472.005149:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1783969472.005163:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1783969472.005177:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1783969472.005191:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1783969472.005205:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1783969472.005217:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1783969472.005228:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1783969472.005252:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1783969472.005293:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1783969472.005309:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1783969472.005322:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1783969472.005333:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1783969472.005348:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1783969472.005361:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1783969472.005373:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1783969472.005407:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1783969472.005422:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1783969472.005436:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1783969472.005449:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1783969472.008214:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1783969472.008234:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1783969472.009980:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1783969472.010017:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1783969472.010032:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1783969472.010067:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1783969472.010084:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1783969472.010099:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1783969472.010124:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1783969472.010139:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1783969472.010153:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1783969472.010167:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1783969472.010181:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1783969472.010194:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1783969472.010206:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1783969472.010217:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1783969472.010229:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1783969472.010242:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1783969472.010254:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1783969472.010266:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1783969472.010279:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1783969472.010308:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1783969472.010369:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969472.012152:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969472.012268:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969472.023588:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099302528 00000100:00100000:2.0:1783969472.023610:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099302528 00000100:00100000:2.0:1783969472.023771:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783969472.023786:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969472.025580:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302528:12345-0@lo:502:mount.lustre.0 Request processed in 1789us (13424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969472.025595:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783969472.026431:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969472.026699:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1783969472.026726:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1783969472.026777:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969472.027359:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969472.027433:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9161d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969472.027759:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099302656 00000100:00100000:1.0:1783969472.027766:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099302656 00000100:00100000:1.0:1783969472.027902:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783969472.027913:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969472.028192:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302656:12345-0@lo:502:mount.lustre.0 Request processed in 281us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969472.028200:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783969472.029777:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783969472.029929:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1783969472.029953:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783969472.034549:0:17864:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1783969472.034570:0:17864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff93eab61299c0) 00000020:00000080:1.0:1783969472.034605:0:17864:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1783969472.037192:0:17864:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93e9835eb000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783969472.037203:0:17864:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93e9835eb000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783969472.037206:0:17864:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93e9835eb000 3 00010000:00080000:0.0:1783969472.037543:0:17864:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eaa01eb800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969472.056678:0:17864:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1783969472.056797:0:17864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783969472.058175:0:17864:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783969472.058195:0:17864:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xea31253a47cbadc0 00000100:00080000:0.0:1783969472.058209:0:17864:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969472.058216:0:17864:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93eaa01eb800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969472.058563:0:17864:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf745c00 x1870627099302784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969472.058641:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870627099302784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969472.058724:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969472.058971:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099302784 00000100:00100000:3.0:1783969472.058981:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099302784 00000100:00080000:0.0:1783969472.059113:0:17864:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783969472.059583:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969472.059598:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1870627099302784:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783969472.059625:0:17113:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1783969472.059661:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xea31253a47cbadc7 00000004:00100000:3.0:1783969472.059682:0:17113:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783969472.059714:0:17113:0:(import.c:65:import_set_state_nolock()) ffff93ea86023000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783969472.061432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969472.061442:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969472.061445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969472.061450:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1783969472.061599:0:17864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:3.0:1783969472.062156:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870627099302784:12345-0@lo:38:llog_process_th.0 Request processed in 2551us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969472.062169:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1783969472.063651:0:17845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783969472.063695:0:17845:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783969472.063718:0:17845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983de7600/0xea31253a47cbadab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbadb2 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.063731:0:17845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e983de7600/0xea31253a47cbadab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbadb2 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783969472.063784:0:17845:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783969472.063786:0:17845:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783969472.063788:0:17845:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969472.063789:0:17845:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969472.063790:0:17845:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969472.063791:0:17845:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969472.063792:0:17845:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783969472.063800:0:17845:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969472.063801:0:17845:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783969472.063805:0:17845:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1783969472.063807:0:17845:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783969472.063809:0:17845:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783969472.063819:0:17845:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969472.063820:0:17845:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969472.063821:0:17845:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969472.063822:0:17845:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969472.063823:0:17845:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783969472.063824:0:17845:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969472.063825:0:17845:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783969472.063853:0:17845:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783969472.063872:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783969472.063948:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969472.064005:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9161d900 going to sleep for 11 seconds 00010000:00080000:2.0:1783969472.073008:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93eabf745c00 x1870627099302784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969472.073046:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969472.073060:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783969472.073072:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783969472.073077:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783969472.073082:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eaa01eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783969472.073090:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870627099302784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969472.073121:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099302912 00000100:00100000:2.0:1783969472.073128:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099302912 00000100:00100000:2.0:1783969472.073190:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783969472.073199:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783969472.073228:0:17107:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783969472.073252:0:17107:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1783969472.087948:0:17092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1783969472.088135:0:17107:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783969472.088188:0:17107:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1783969472.090317:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:17845:x1870627099302912:12345-0@lo:253:mount.lustre.0 Request processed in 17108us (26367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969472.090333:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783969472.090719:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:17845:1870627099302912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783969472.090737:0:17845:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783969472.090741:0:17845:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969472.090742:0:17845:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783969472.090744:0:17845:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969472.090745:0:17845:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969472.090746:0:17845:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969472.090748:0:17845:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969472.090749:0:17845:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969472.090751:0:17845:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969472.090752:0:17845:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783969472.090767:0:17845:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1783969472.096673:0:17128:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783969472.096686:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783969472.096781:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.096805:0:17128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbaccb expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.096822:0:17128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbad8f expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.096831:0:17128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.096884:0:17128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbad8f expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.096900:0:17128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbad8f expref: 17 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969472.096931:0:17128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099303040:0@lo:104: 00000100:00100000:0.0:1783969472.097043:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969472.097105:0:17128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbaccb expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.097114:0:17128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbaccb expref: 17 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969472.097122:0:17128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099303168:0@lo:104: 00000100:00100000:0.0:1783969472.097144:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969472.097172:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099303040 00000100:00100000:0.0:1783969472.097179:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099303040 00000100:00100000:0.0:1783969472.097214:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099303168 00000100:00100000:0.0:1783969472.097217:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099303168 00000100:00100000:0.0:1783969472.097230:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969472.097240:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+4:17128:x1870627099303040:12345-0@lo:104: 00010000:00010000:0.0:1783969472.097253:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.097299:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969472.097305:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+4:17128:x1870627099303040:12345-0@lo:104: Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969472.097312:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969472.097327:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969472.097334:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+3:17128:x1870627099303168:12345-0@lo:104: 00010000:00010000:0.0:1783969472.097341:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.098119:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969472.098127:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+3:17128:x1870627099303168:12345-0@lo:104: Request processed in 793us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969472.098135:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969472.098163:0:17128:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9161d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969472.098188:0:17128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf746d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099303040:0@lo:104: 00000100:00100000:0.0:1783969472.098198:0:17128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099303168:0@lo:104: 00010000:00010000:0.0:1783969472.098221:0:17128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098314:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969472.098321:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098329:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:1.0:1783969472.098333:0:17100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098342:0:17100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969472.098349:0:17100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969472.098355:0:17100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783969472.098418:0:17100:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098425:0:17100:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969472.098446:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098473:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea83dae600/0xea31253a47cbad8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbad96 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098485:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969472.098488:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098493:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52000 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:1.0:1783969472.098495:0:17100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098502:0:17100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969472.098508:0:17100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969472.098512:0:17100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783969472.098525:0:17100:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098529:0:17100:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969472.098543:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098549:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea91a52000/0xea31253a47cbaccb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbacd2 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098559:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969472.098565:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969472.098567:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969472.098580:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099303296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969472.098621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969472.098657:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099303424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969472.098676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969472.098716:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099303296 00000100:00100000:1.0:1783969472.098720:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099303296 00010000:00010000:1.0:1783969472.098739:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbad8f expref: 18 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969472.098756:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099303424 00000100:00100000:1.0:1783969472.098758:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099303424 00010000:00010000:1.0:1783969472.098766:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbaccb expref: 19 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969472.098777:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969472.098782:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+19:3647:x1870627099303296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969472.098794:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969472.098798:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbad8f expref: 19 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.098808:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbad8f expref: 19 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099129:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdec00/0xea31253a47cbad96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbad8f expref: 19 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099141:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969472.099181:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+18:3647:x1870627099303296:12345-0@lo:103:ldlm_bl.0 Request processed in 398us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969472.099196:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969472.099212:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969472.099218:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+17:3648:x1870627099303424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969472.099226:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969472.099231:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbaccb expref: 17 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099239:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbaccb expref: 17 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099248:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea83dae200/0xea31253a47cbacd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbaccb expref: 17 pid: 17106 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099259:0:17098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099267:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783969472.099280:0:17098:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002745866s 00010000:00010000:1.0:1783969472.099284:0:17098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099291:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099297:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099303:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099313:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdee00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969472.099317:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099325:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099339:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099348:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969472.099372:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+16:3648:x1870627099303424:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969472.099403:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969472.099436:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099303424:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969472.099514:0:17128:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099522:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.099528:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cdee00/0xea31253a47cbadce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969472.099592:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099303296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969472.099644:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783969472.112974:0:17845:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1783969472.113226:0:17871:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1783969472.113231:0:17871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783969472.115116:0:17872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1783969472.115808:0:17872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783969472.118639:0:17845:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1783969472.119750:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783969472.120009:0:17872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1783969472.120793:0:17873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1870627099303552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783969472.120950:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969472.120986:0:17873:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84e48c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969472.121148:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099303552 00000100:00100000:2.0:1783969472.121156:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099303552 00000100:00100000:2.0:1783969472.121216:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969472.121226:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17873:x1870627099303552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783969472.121313:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17873:x1870627099303552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 88us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969472.121320:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969472.122175:0:17873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1870627099303552:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1783969472.122212:0:17873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783969472.122250:0:17873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1870627099303680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783969472.122297:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969472.122324:0:17873:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9161d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969472.122458:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099303680 00000100:00100000:2.0:1783969472.122463:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099303680 00000100:00100000:2.0:1783969472.122500:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969472.122508:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17873:x1870627099303680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783969472.122620:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17873:x1870627099303680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969472.122628:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969472.122755:0:17873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1870627099303680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783969472.122824:0:17873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17873:1870627099303808:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1783969472.122854:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969472.122879:0:17873:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9161d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969472.123020:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099303808 00000100:00100000:2.0:1783969472.123034:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099303808 00000100:00100000:2.0:1783969472.123065:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969472.123072:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17873:x1870627099303808:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1783969472.123110:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17873:x1870627099303808:12345-0@lo:900:lod0001_rec0000.0 Request processed in 38us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969472.123116:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783969472.123445:0:17873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93eabf745880 x1870627099303808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783969488 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969472.123466:0:17873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17873:1870627099303808:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1783969472.123522:0:17873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1870627099303936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783969472.123548:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969472.123579:0:17873:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9161d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969472.123689:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099303936 00000100:00100000:2.0:1783969472.123693:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099303936 00000100:00100000:2.0:1783969472.123728:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969472.123734:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17873:x1870627099303936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783969472.123785:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17873:x1870627099303936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 52us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969472.123797:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783969472.124181:0:17873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1870627099303936:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1783969472.124226:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783969472.125273:0:17845:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1783969472.125312:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783969472.126257:0:17845:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783969472.126269:0:17845:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1783969472.126331:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969472.129279:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783969472.129357:0:17873:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783969472.129363:0:17873:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1783969472.129804:0:17845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783969472.132713:0:17845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783969472.133229:0:17845:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1783969472.133569:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783969472.136231:0:17845:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1783969472.139293:0:17845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1783969472.151441:0:17845:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783969472.151560:0:17845:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffafc3c0d87988 00100000:10000000:0.0:1783969472.151570:0:17845:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783969472.155250:0:17845:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783969472.155296:0:17845:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783969472.155313:0:17845:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783969472.155341:0:17845:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1783969472.162281:0:17845:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783969472.164325:0:17845:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783969472.178149:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783969472.758552:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783969473.140769:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783969473.201097:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783969473.776477:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783969473.905292:0:17109:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783969473.905301:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93e9835eb000 from 8 10000000:01000000:0.0:1783969473.905305:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783969473.905377:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969473.905508:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969473.905519:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969473.905546:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099304064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969473.905797:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969473.905891:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea85fc4180 going to sleep for 11 seconds 00000100:00100000:1.0:1783969473.906735:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099304064 00000100:00100000:1.0:1783969473.906744:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099304064 00000100:00100000:1.0:1783969473.906803:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783969473.906813:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+16:17109:x1870627099304064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969473.906826:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969473.906845:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbadd5 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969473.906869:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbadd5 expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969473.906879:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbadd5 expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969473.906889:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7c00, rc 0) 00000100:00100000:1.0:1783969473.907063:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099304064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969473.907071:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783969473.907240:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099304064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969473.907256:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969473.907265:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969473.907321:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099304192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783969473.907352:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969473.907475:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099304192 00000100:00100000:3.0:1783969473.907480:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099304192 00000100:00100000:3.0:1783969473.907525:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783969473.907532:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099304192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783969473.907547:0:17107:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783969473.907563:0:17107:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783969473.907566:0:17107:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783969473.907649:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099304192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969473.907656:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783969473.911258:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea85fc4180 going to sleep for 11 seconds 00000100:00100000:0.0:1783969473.911302:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099304192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783969473.911407:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783969473.911419:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969473.911432:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969473.911445:0:17109:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783969473.911448:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93e98330a000 from 8 10000000:01000000:0.0:1783969473.911451:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783969473.911486:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969473.911494:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969473.911519:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969473.911540:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099304320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969473.911598:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969473.913053:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099304320 00000100:00100000:2.0:1783969473.913066:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099304320 00000100:00100000:2.0:1783969473.913128:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969473.913139:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099304320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969473.913154:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969473.913172:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbade3 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969473.913200:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbade3 expref: 18 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969473.913212:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbade3 expref: 18 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969473.913222:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dafc00, rc 0) 00000100:00100000:2.0:1783969473.913271:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+18:17109:x1870627099304320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969473.913278:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783969473.919360:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eaa5a11900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969473.919438:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099304320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969473.919471:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969473.919489:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969473.919587:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099304448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783969473.919662:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969473.919709:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8b0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969473.919795:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099304448 00000100:00100000:0.0:1783969473.919802:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099304448 00000100:00100000:0.0:1783969473.919874:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783969473.919884:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17109:x1870627099304448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783969473.920178:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783969473.920196:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783969473.920199:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1783969473.920329:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17109:x1870627099304448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 446us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969473.920341:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783969473.920470:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099304448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783969473.920540:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969473.920554:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969473.920564:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969474.161562:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783969474.224465:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783969474.803482:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969475.248914:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783969475.825331:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969476.290964:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783969476.849567:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969476.983326:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099304576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969476.983471:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969476.983592:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099304576 00000100:00100000:3.0:1783969476.983601:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099304576 00000100:00100000:3.0:1783969476.983661:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969476.983671:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099304576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969476.983715:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783969476.983779:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099304576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969476.983786:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969476.983875:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099304576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969477.303129:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 0 seconds 00000001:02000400:0.0:1783969477.371230:0:18115:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1783969477.489162:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783969477.489169:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783969477.489173:0:38:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969477.489187:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93eab6109800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969477.489211:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea867b0700 x1870627099304832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783969477.489230:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969477.489233:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969477.489236:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969477.489239:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969477.489251:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969477.489253:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969477.489256:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969477.489259:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783969477.489293:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099304832:0@lo:38:kworker.0 00000100:00100000:1.0:1783969477.489356:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969477.489440:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099305088:0@lo:400:kworker.0 00000100:00100000:1.0:1783969477.489478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969477.489567:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099304960:0@lo:400:kworker.0 00000100:00100000:0.0:1783969477.489596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969477.489668:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969477.489674:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099304704:0@lo:400:kworker.0 00000100:00100000:0.0:1783969477.489701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969477.489735:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099304832 00000100:00100000:0.0:1783969477.489741:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099304832 00000100:00100000:0.0:1783969477.489771:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969477.489785:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1870627099304832:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783969477.489811:0:17854:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:0.0:1783969477.489861:0:17854:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cbadf1 00000004:00100000:0.0:1783969477.489877:0:17854:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1783969477.489882:0:17854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1783969477.489950:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099305088 00000100:00100000:0.0:1783969477.489953:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099305088 00000100:00100000:0.0:1783969477.489982:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099304960 00000100:00100000:0.0:1783969477.489985:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099304960 00000100:00100000:0.0:1783969477.489998:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969477.490004:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099305088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969477.490050:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099305088:12345-0@lo:400:kworker.0 Request processed in 45us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969477.490056:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969477.490071:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783969477.490077:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099304960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969477.490109:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099304960:12345-0@lo:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969477.490114:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783969477.490131:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099304704 00000100:00100000:0.0:1783969477.490135:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099304704 00000100:00100000:0.0:1783969477.490158:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783969477.490163:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:3647:x1870627099304704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969477.490207:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:3647:x1870627099304704:12345-0@lo:400:kworker.0 Request processed in 44us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969477.490213:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1783969477.490270:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ea867b2a00 x1870627099305088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969477.490282:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099305088:0@lo:400:kworker.0 00000100:00100000:0.0:1783969477.490307:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099304704:0@lo:400:kworker.0 00010000:00080000:0.0:1783969477.490317:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ea867b3b80 x1870627099304960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969477.490325:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099304960:0@lo:400:kworker.0 00000100:00080000:3.0:1783969477.506707:0:17854:0:(import.c:65:import_set_state_nolock()) ffff93eabf7e2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969477.506826:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1870627099304832:12345-0@lo:38:kworker.0 Request processed in 17039us (17467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969477.506838:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1783969477.506936:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783969477.506947:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783969477.506952:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783969477.506955:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab6109800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1783969477.506977:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000036b5df19): req@ffff93e983d22a00 x1870627099297280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969477.506997:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099304832:0@lo:38:kworker.0 00000100:00100000:3.0:1783969477.507210:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969477.507224:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099305216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969477.507262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969477.507457:0:17154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969477.507476:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84fb09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969477.507490:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099305216 00000100:00100000:1.0:1783969477.507495:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099305216 00000100:00100000:1.0:1783969477.507540:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099297280 00000100:00100000:1.0:1783969477.507543:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099297280 00000100:00100000:1.0:1783969477.507557:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969477.507565:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1870627099305216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969477.507592:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783969477.507679:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1870627099305216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969477.507686:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969477.507701:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969477.507707:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17154:x1870627099297280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783969477.507758:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17154:x1870627099297280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 51us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969477.507765:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969477.507788:0:17154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17154:1870627099297280:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783969477.507819:0:17154:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783969477.507868:0:17154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17154:1870627099305344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783969477.507896:0:17154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969477.507918:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea85fc5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969477.507928:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099305344 00000100:00100000:1.0:1783969477.507931:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099305344 00000100:00100000:1.0:1783969477.507948:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783969477.507953:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17154:x1870627099305344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783969477.508230:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17154:x1870627099305344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 276us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969477.508237:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783969477.508262:0:17154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17154:1870627099305344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783969477.508320:0:17154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17154:1870627099305472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783969477.508343:0:17154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969477.508362:0:17154:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea85fc5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969477.508423:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099305216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969477.508479:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099305472 00000100:00100000:3.0:1783969477.508484:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099305472 00000100:00100000:3.0:1783969477.508515:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969477.508523:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17154:x1870627099305472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783969477.508572:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17154:x1870627099305472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969477.508579:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783969477.508678:0:17154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17154:1870627099305472:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783969477.508718:0:17154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969477.516715:0:17154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783969477.516801:0:17154:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:1.0:1783969477.516807:0:17154:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1783969477.872549:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969478.258186:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1783969478.485680:0:18167:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969478.485879:0:18167:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783969478.896609:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783969479.736760:0:18218:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783969479.736967:0:18218:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783969479.925675:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969480.560497:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969465/real 1783969465] req@ffff93ea867b3480 x1870627099298304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969480 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969480.560527:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ea867b3480 x1870627099298304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969480 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969480.560538:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969465/real 1783969465] req@ffff93ea867b0e00 x1870627099298432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969480 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969480.560551:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ea867b0e00 x1870627099298432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969480 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783969480.560572:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea88952800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783969480.560586:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783969480.560597:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099298304:0@lo:8:kworker.0 00000100:00080000:3.0:1783969480.560603:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783969480.560609:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783969480.560612:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099298432:0@lo:8:kworker.0 00000100:00080000:2.0:1783969480.561128:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969480.561132:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783969480.561140:0:38:0:(import.c:65:import_set_state_nolock()) ffff93ea88952800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783969480.561145:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1783969480.561152:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783969480.561160:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ea88952800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969480.561185:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e98319d880 x1870627099305856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969480.561200:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969480.561203:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783969480.561204:0:38:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783969480.561208:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1783969480.561210:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783969480.561213:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93eab9286000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969480.561224:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e98319df80 x1870627099305984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969480.561257:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969480.561261:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783969480.561264:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969480.561267:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783969480.561292:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099306112:0@lo:400:kworker.0 00000100:00100000:2.0:1783969480.561356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969480.561412:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969480.561418:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099306240:0@lo:400:kworker.0 00000100:00100000:2.0:1783969480.561449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969480.561523:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099305728:0@lo:400:kworker.0 00000100:00100000:0.0:1783969480.561552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969480.561590:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783969480.561596:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099305600:0@lo:400:kworker.0 00000100:00100000:0.0:1783969480.561621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969480.561643:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099306368:0@lo:400:kworker.0 00000100:00100000:0.0:1783969480.561685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969480.561717:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099306112 00000100:00100000:0.0:1783969480.561723:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099306112 00000100:00100000:0.0:1783969480.561758:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099306368 00000100:00100000:0.0:1783969480.561761:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099306368 00000100:00100000:0.0:1783969480.561774:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969480.561781:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099306112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969480.561838:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099306112:12345-0@lo:400:kworker.0 Request processed in 56us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969480.561846:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969480.561861:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969480.561866:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099306368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969480.561907:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099306368:12345-0@lo:400:kworker.0 Request processed in 41us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969480.561913:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969480.561931:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099305600 00000100:00100000:0.0:1783969480.561934:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099305600 00000100:00100000:0.0:1783969480.561958:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783969480.561963:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+18:3647:x1870627099305600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969480.561991:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+18:3647:x1870627099305600:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969480.561997:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1783969480.562043:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93e98319c700 x1870627099306112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969480.562054:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099306112:0@lo:400:kworker.0 00000100:00100000:0.0:1783969480.562074:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099305600:0@lo:400:kworker.0 00010000:00080000:0.0:1783969480.562091:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93e98319f800 x1870627099306368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969480.562099:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099306368:0@lo:400:kworker.0 00000100:00100000:3.0:1783969480.562779:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099306240 00000100:00100000:3.0:1783969480.562785:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099306240 00000100:00100000:3.0:1783969480.562829:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099305728 00000100:00100000:3.0:1783969480.562832:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099305728 00000100:00100000:3.0:1783969480.562847:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969480.562853:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099306240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969480.562915:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099306240:12345-0@lo:400:kworker.0 Request processed in 62us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969480.562922:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969480.562933:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969480.562939:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099305728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969480.562967:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099305728:12345-0@lo:400:kworker.0 Request processed in 29us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969480.562974:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969480.562991:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099305856:0@lo:8:kworker.0 00000400:00000100:3.0:1783969480.563016:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099305856 offset 0 length 520: 4 00000100:00100000:3.0:1783969480.563047:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099305984:0@lo:8:kworker.0 00000400:00000100:3.0:1783969480.563062:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099305984 offset 0 length 520: 4 00000100:00100000:3.0:1783969480.563093:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099306240:0@lo:400:kworker.0 00000100:00100000:0.0:1783969480.563810:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099305728:0@lo:400:kworker.0 00010000:00010000:0.0:1783969480.945652:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783969481.029836:0:18266:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6e3872f0 20000000:00000080:1.0:1783969481.029854:0:18266:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ea848f2000 uarg=0000000000000000 20000000:01000000:1.0:1783969481.029894:0:18266:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783969481.029901:0:18266:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783969481.029906:0:18266:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783969481.037312:0:18267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1783969481.038115:0:18266:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783969481.044109:0:18266:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783969481.044142:0:18266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969481.044164:0:18266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbac9a expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969481.044191:0:18266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbad9d expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969481.044199:0:18266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969481.044252:0:18266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbad9d expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969481.044266:0:18266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbad9d expref: 17 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969481.044280:0:18266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18266:1870627099306496:0@lo:104: 00000100:00100000:1.0:1783969481.044584:0:18266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969481.044749:0:18266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbac9a expref: 17 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969481.044769:0:18266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbac9a expref: 17 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969481.044778:0:18266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18266:1870627099306624:0@lo:104: 00000100:00100000:3.0:1783969481.044818:0:18266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969481.045347:0:18266:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea912f3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969481.045594:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099306496 00000100:00100000:0.0:1783969481.045602:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099306496 00000100:00100000:1.0:1783969481.045641:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099306624 00000100:00100000:1.0:1783969481.045645:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099306624 00000100:00100000:1.0:1783969481.045687:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969481.045696:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+4:18266:x1870627099306624:12345-0@lo:104: 00010000:00010000:1.0:1783969481.045710:0:17095:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969481.045825:0:17095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969481.045832:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+4:18266:x1870627099306624:12345-0@lo:104: Request processed in 136us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969481.045840:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969481.045921:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969481.045928:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+3:18266:x1870627099306496:12345-0@lo:104: 00010000:00010000:1.0:1783969481.045947:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969481.045984:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783969481.045989:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+3:18266:x1870627099306496:12345-0@lo:104: Request processed in 62us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969481.045996:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1783969481.046037:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969481.046044:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046051:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf000 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969481.046054:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046063:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969481.046070:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969481.046075:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783969481.046107:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046115:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969481.046134:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046141:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea83daf000/0xea31253a47cbac9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaca1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046155:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969481.046158:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046163:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52c00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:2.0:1783969481.046166:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046179:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969481.046185:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969481.046190:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783969481.046204:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046209:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969481.046223:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046229:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea91a52c00/0xea31253a47cbad9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbada4 expref: -99 pid: 17845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046240:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969481.046241:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969481.046243:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969481.046257:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969481.046267:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099306752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969481.046300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969481.046330:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099306880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969481.046361:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969481.046464:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099306752 00000100:00100000:2.0:1783969481.046469:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099306752 00010000:00010000:2.0:1783969481.046491:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbac9a expref: 18 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969481.046524:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099306880 00000100:00100000:2.0:1783969481.046527:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099306880 00010000:00010000:2.0:1783969481.046540:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbad9d expref: 19 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969481.046551:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969481.046557:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+19:3646:x1870627099306752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969481.046568:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969481.046574:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbac9a expref: 19 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046584:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbac9a expref: 19 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046599:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969481.046626:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+19:3646:x1870627099306752:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969481.046631:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969481.046644:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969481.046651:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+18:3648:x1870627099306880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969481.046659:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969481.046663:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbad9d expref: 18 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046671:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbad9d expref: 18 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046683:0:17097:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046697:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046711:0:17097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046718:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046725:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046732:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046737:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de6400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969481.046741:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046747:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046756:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969481.046765:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969481.046809:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+18:3648:x1870627099306880:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969481.046816:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1783969481.047071:0:18266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cde000/0xea31253a47cbaca1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbac9a expref: 17 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969481.047084:0:18266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18266:1870627099306624:0@lo:104: 00010000:00010000:3.0:1783969481.047095:0:18266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e983de6600/0xea31253a47cbada4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbad9d expref: 16 pid: 17106 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969481.047103:0:18266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18266:1870627099306496:0@lo:104: 00010000:00010000:3.0:1783969481.047123:0:18266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969481.047131:0:18266:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969481.047137:0:18266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969481.047143:0:18266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e983de6400/0xea31253a47cbadf8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969481.048777:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969481.061508:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099306752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969481.061657:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099306880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969481.584544:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969471/real 1783969471] req@ffff93eabf744700 x1870627099300992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969481.584581:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93eabf744700 x1870627099300992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969481.584591:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969471/real 1783969471] req@ffff93eabf745500 x1870627099300864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969481.584601:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93eabf745500 x1870627099300864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783969481.584620:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783969481.585211:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783969481.585217:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099300992:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783969481.585224:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e9835e9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969481.585371:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969481.585376:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783969481.585378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969481.585410:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783969481.585435:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969481.585437:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783969481.585440:0:8:0:(import.c:65:import_set_state_nolock()) ffff93e9835e9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783969481.585445:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 534 00000100:00080000:2.0:1783969481.585449:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783969481.585456:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93e9835e9000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969481.585476:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e98319c700 x1870627099307392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969481.585485:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969481.585488:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783969481.585490:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783969481.585493:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 534 00000100:00080000:2.0:1783969481.585495:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783969481.585499:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93ea8325a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969481.585509:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e98319e680 x1870627099307520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969481.585543:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099307008:0@lo:400:kworker.0 00000100:00100000:2.0:1783969481.585608:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969481.585640:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969481.585656:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099307648:0@lo:400:kworker.0 00000100:00100000:2.0:1783969481.585680:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969481.585717:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099307136:0@lo:400:kworker.0 00000100:00100000:2.0:1783969481.585739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969481.585757:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969481.585762:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099307264:0@lo:400:kworker.0 00000100:00100000:2.0:1783969481.585794:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969481.585834:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099307008 00000100:00100000:2.0:1783969481.585841:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099307008 00000100:00100000:2.0:1783969481.585879:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099307264 00000100:00100000:2.0:1783969481.585882:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099307264 00000100:00100000:2.0:1783969481.585905:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783969481.585913:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1870627099307008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969481.585963:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1870627099307008:12345-0@lo:400:kworker.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969481.585969:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783969481.585986:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783969481.585991:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099307264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969481.586021:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099307264:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969481.586027:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783969481.586050:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099307648 00000100:00100000:2.0:1783969481.586053:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099307648 00000100:00100000:2.0:1783969481.586074:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099307136 00000100:00100000:2.0:1783969481.586077:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099307136 00000100:00100000:2.0:1783969481.586088:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969481.586094:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099307648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969481.586132:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099307648:12345-0@lo:400:kworker.0 Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969481.586139:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969481.586152:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969481.586157:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099307136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969481.586182:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099307136:12345-0@lo:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969481.586188:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969481.586230:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099307264:0@lo:400:kworker.0 00010000:00080000:2.0:1783969481.586241:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93e98319f800 x1870627099307136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969481.586250:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099307136:0@lo:400:kworker.0 00010000:00080000:2.0:1783969481.586279:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93e98319c000 x1870627099307648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969481.586287:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099307648:0@lo:400:kworker.0 00000100:00100000:2.0:1783969481.586295:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099307008:0@lo:400:kworker.0 00000100:00080000:3.0:1783969481.595409:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783969481.595420:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099300864:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783969481.595460:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099307392:0@lo:8:kworker.0 00000400:00000100:3.0:1783969481.595514:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099307392 offset 0 length 520: 4 00000100:00100000:3.0:1783969481.595552:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099307520:0@lo:8:kworker.0 00000400:00000100:3.0:1783969481.595570:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627099307520 offset 0 length 520: 4 00000100:00080000:0.0:1783969481.595702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969481.595707:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783969481.595709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969481.595712:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1783969481.968645:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969482.103246:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099307776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969482.103335:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969482.104001:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099307776 00000100:00100000:0.0:1783969482.104010:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099307776 00000100:00100000:0.0:1783969482.104070:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783969482.104080:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099307776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969482.104117:0:17854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783969482.122928:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099307776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 18838us (19582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969482.122946:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969482.133814:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099307776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969482.608757:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969482.608793:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099307904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969482.608888:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969482.609034:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099307904 00000100:00100000:3.0:1783969482.609043:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099307904 00000100:00100000:3.0:1783969482.609100:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969482.609108:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099307904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969482.609139:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783969482.609192:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1870627099307904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969482.609213:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969482.609260:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099307904:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1783969482.610832:0:17846:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:2.0:1783969482.928698:0:17109:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783969482.928706:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e9835eb000 from 13 10000000:01000000:2.0:1783969482.928712:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969482.928773:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969482.928785:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969482.928815:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969482.928858:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969482.928931:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969482.928979:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969482.929104:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099308032 00000100:00100000:0.0:1783969482.929111:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099308032 00000100:00100000:0.0:1783969482.929169:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783969482.929180:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+16:17109:x1870627099308032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969482.929200:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969482.929214:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbadff expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969482.929238:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbadff expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969482.929249:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbadff expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969482.929259:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea89cde400, rc 0) 00000100:00100000:0.0:1783969482.929305:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099308032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969482.929312:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969482.929490:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969482.929506:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969482.929516:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969482.929577:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969482.929606:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969482.929635:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e98222aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969482.929757:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099308160 00000100:00100000:0.0:1783969482.929772:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099308160 00000100:00100000:0.0:1783969482.929808:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783969482.929815:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099308160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969482.929990:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099308160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969482.929997:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783969482.930511:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969482.930552:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969482.930598:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969482.930631:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419240 going to sleep for 11 seconds 00000100:00100000:1.0:1783969482.930692:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099308288 00000100:00100000:1.0:1783969482.930697:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099308288 00000100:00100000:1.0:1783969482.930723:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783969482.930731:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099308288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969482.930843:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099308288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969482.930859:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783969482.930986:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783969482.937642:0:18331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783969482.937710:0:17109:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783969482.937733:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969482.937745:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969482.937757:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969482.937789:0:17109:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969482.937791:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e98330a000 from 13 10000000:01000000:1.0:1783969482.937794:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969482.937833:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969482.937841:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969482.937975:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969482.938005:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969482.938078:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969482.938118:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9161ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969482.938140:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099308416 00000100:00100000:1.0:1783969482.938148:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099308416 00000100:00100000:1.0:1783969482.938193:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783969482.938201:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+17:17109:x1870627099308416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969482.938214:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969482.938227:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbae0d expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969482.938249:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbae0d expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969482.938259:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbae0d expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969482.938280:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6200, rc 0) 00000100:00100000:1.0:1783969482.938319:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17109:x1870627099308416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969482.938327:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783969482.938376:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969482.938414:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969482.938423:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969482.938469:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969482.938494:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969482.938506:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9161ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969482.938516:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099308544 00000100:00100000:1.0:1783969482.938520:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099308544 00000100:00100000:1.0:1783969482.938541:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783969482.938546:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17109:x1870627099308544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969482.938649:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17109:x1870627099308544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969482.938657:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783969482.938687:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969482.938713:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969482.938753:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969482.938788:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9161ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969482.938799:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099308672 00000100:00100000:1.0:1783969482.938802:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099308672 00000100:00100000:1.0:1783969482.938825:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783969482.938841:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17109:x1870627099308672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969482.941469:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:17109:x1870627099308672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2631us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969482.941484:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783969482.941619:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099308672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783969482.943808:0:18332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783969482.944194:0:17109:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783969482.944223:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969482.944234:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969482.944246:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969482.992605:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969484.016655:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783969484.403557:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783969485.040740:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969486.064657:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783969486.707051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969486.707059:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783969486.707062:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969486.707082:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783969486.707101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969486.707104:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783969486.707107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969486.707110:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783969486.707199:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099308928:0@lo:400:kworker.0 00000100:00100000:1.0:1783969486.707270:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969486.707326:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969486.707332:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099309056:0@lo:400:kworker.0 00000100:00100000:1.0:1783969486.707357:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969486.707418:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099309056 00000100:00100000:1.0:1783969486.707424:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099309056 00000100:00100000:1.0:1783969486.707469:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783969486.707478:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099309056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969486.707526:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099309056:12345-0@lo:400:kworker.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969486.707539:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783969486.707580:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93eabf744700 x1870627099309056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969486.707593:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099309056:0@lo:400:kworker.0 00000100:00100000:3.0:1783969486.707685:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099308800:0@lo:400:kworker.0 00000100:00100000:3.0:1783969486.707732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969486.707763:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099309312:0@lo:400:kworker.0 00000100:00100000:3.0:1783969486.707799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969486.707817:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969486.707822:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099309184:0@lo:400:kworker.0 00000100:00100000:3.0:1783969486.707843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969486.707869:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099308928 00000100:00100000:3.0:1783969486.707873:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099308928 00000100:00100000:3.0:1783969486.707896:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099309184 00000100:00100000:3.0:1783969486.707899:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099309184 00000100:00100000:3.0:1783969486.707912:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969486.707918:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099308928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969486.707952:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099308928:12345-0@lo:400:kworker.0 Request processed in 34us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969486.707958:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969486.707969:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969486.707983:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099309184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969486.708014:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099309184:12345-0@lo:400:kworker.0 Request processed in 31us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969486.708019:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969486.708042:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099309184:0@lo:400:kworker.0 00000100:00100000:1.0:1783969486.708265:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099308800 00000100:00100000:1.0:1783969486.708269:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099308800 00000100:00100000:1.0:1783969486.708304:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783969486.708310:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:3647:x1870627099308800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969486.708346:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+18:3647:x1870627099308800:12345-0@lo:400:kworker.0 Request processed in 36us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969486.708351:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783969486.708410:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099308800:0@lo:400:kworker.0 00000100:00100000:1.0:1783969486.708433:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099308928:0@lo:400:kworker.0 00000100:00100000:2.0:1783969486.709221:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099309312 00000100:00100000:2.0:1783969486.709227:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099309312 00000100:00100000:2.0:1783969486.709266:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783969486.709274:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099309312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969486.709327:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099309312:12345-0@lo:400:kworker.0 Request processed in 53us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969486.709332:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1783969486.709375:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93eabf744380 x1870627099309312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969486.709408:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099309312:0@lo:400:kworker.0 00010000:00010000:1.0:1783969487.091962:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969487.216553:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969487.216574:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099309440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969487.216638:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969487.216675:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099309440 00000100:00100000:3.0:1783969487.216683:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099309440 00000100:00100000:3.0:1783969487.216738:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969487.216747:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099309440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969487.216791:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783969487.216834:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099309440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969487.216842:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969487.216928:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099309440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969487.728941:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099309568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969487.729023:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969487.729215:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099309568 00000100:00100000:2.0:1783969487.729222:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099309568 00000100:00100000:2.0:1783969487.729276:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783969487.729286:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099309568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969487.729319:0:17854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783969487.729375:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099309568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969487.729406:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783969487.729498:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099309568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783969488.113631:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783969488.497146:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783969489.140106:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783969489.360775:0:18615:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783969489.360779:0:18615:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783969489.360780:0:18615:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1783969489.360907:0:18615:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93eaa01ec800 00000020:01000004:0.0:1783969489.360930:0:18615:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783969489.360944:0:18615:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783969489.360957:0:18615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93eab9208000) 00000020:00000080:0.0:1783969489.360976:0:18615:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783969489.490314:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783969489.498061:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783969489.498762:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783969489.499312:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783969489.499697:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783969489.500000:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783969489.500481:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1783969489.507889:0:18615:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783969489.508130:0:18615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783969489.508144:0:18615:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783969489.508161:0:18615:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xea31253a47cbae22 00000020:01000004:3.0:1783969489.508169:0:18615:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783969489.508195:0:18615:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783969489.508198:0:18615:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783969489.508204:0:18615:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783969489.508209:0:18615:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783969489.508221:0:18615:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93eac0e78000) 00000020:00000080:3.0:1783969489.508232:0:18615:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1783969489.509409:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969489.509552:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783969489.509558:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783969489.517165:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783969489.517177:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783969489.533592:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783969489.533616:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783969489.537115:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969489.537301:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783969489.537307:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783969489.554399:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783969489.554414:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783969489.610165:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969489.610448:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783969489.610455:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783969489.621208:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783969489.621223:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1783969489.625054:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783969489.625069:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783969489.627016:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969489.627225:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783969489.627234:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783969489.628636:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783969489.628646:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783969489.797474:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969489.797688:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783969489.797695:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783969489.802574:0:18615:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783969489.802593:0:18615:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783969489.803144:0:18615:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783969489.803174:0:18615:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783969489.803180:0:18615:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1783969489.834807:0:18615:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783969489.834861:0:18615:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1783969489.834866:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783969489.834868:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783969489.834870:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969489.834871:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969489.834872:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969489.834874:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969489.834876:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969489.834882:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969489.834883:0:18615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783969489.834887:0:18615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1783969489.834889:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783969489.834891:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783969489.834892:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969489.834893:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969489.834894:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969489.834895:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969489.834896:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969489.834897:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969489.834898:0:18615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783969489.834925:0:18615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783969489.834946:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099309696:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783969489.835019:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.835065:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074480 going to sleep for 11 seconds 00000100:00100000:2.0:1783969489.835170:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099309696 00000100:00100000:2.0:1783969489.835179:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099309696 00000100:00100000:2.0:1783969489.835241:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783969489.835251:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:18615:x1870627099309696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783969489.835295:0:17105:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783969489.835298:0:17105:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1783969489.835302:0:17105:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783969489.835894:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+18:18615:x1870627099309696:12345-0@lo:253:mount.lustre.0 Request processed in 641us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969489.835904:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783969489.836010:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099309696:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783969489.836021:0:18615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783969489.836023:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783969489.836025:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783969489.836026:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969489.836027:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969489.836029:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969489.836030:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969489.836031:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969489.836032:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969489.836033:0:18615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783969489.836051:0:18615:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93eaa01ec800 from lustre-OST0000 10000000:01000000:0.0:1783969489.836088:0:18615:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783969489.836091:0:18615:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783969489.836098:0:18615:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93eab71619c0 local copy 00010000:00010000:0.0:1783969489.836108:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969489.836196:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099309824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969489.836231:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.836301:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5300 going to sleep for 11 seconds 00000100:00100000:3.0:1783969489.846659:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099309824 00000100:00100000:3.0:1783969489.846673:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099309824 00000100:00100000:3.0:1783969489.846731:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969489.846752:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+18:18615:x1870627099309824:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969489.846905:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+18:18615:x1870627099309824:12345-0@lo:501:mount.lustre.0 Request processed in 165us (10672us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783969489.847009:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099309824:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783969489.847032:0:18615:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783969489.847057:0:18615:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783969489.847067:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969489.847078:0:18615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969489.847112:0:18615:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93eaa01ec800 10000000:01000000:0.0:1783969489.847116:0:18615:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783969489.847122:0:18615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783969489.847125:0:18615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783969489.847129:0:18615:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783969489.847132:0:18615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783969489.847161:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cbae30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969489.847169:0:18615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cbae30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969489.847178:0:18615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cbae30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969489.847197:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099309952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783969489.847234:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.847291:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969489.847472:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099309952 00000100:00100000:2.0:1783969489.847477:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099309952 00000100:00100000:2.0:1783969489.847502:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783969489.847509:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+19:18615:x1870627099309952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969489.847520:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969489.847533:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea83dae200/0xea31253a47cbae37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbae30 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969489.847554:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea83dae200/0xea31253a47cbae37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbae30 expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969489.847564:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea83dae200/0xea31253a47cbae37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbae30 expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969489.847573:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83dae200, rc 0) 00000100:00100000:2.0:1783969489.847610:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099309952:12345-0@lo:101:mount.lustre.0 Request processed in 101us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969489.847617:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783969489.847704:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099309952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969489.847716:0:18615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cbae30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae37 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969489.847725:0:18615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cbae30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbae37 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969489.848894:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000040:00080000:0.0:1783969489.849075:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783969489.849692:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969489.854155:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783969489.854215:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783969489.854230:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783969489.854243:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783969489.854256:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783969489.854269:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783969489.854295:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783969489.854300:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783969489.855041:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969489.855111:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.855218:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969489.855325:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099310080 00000100:00100000:2.0:1783969489.855332:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099310080 00000100:00100000:2.0:1783969489.855524:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783969489.855535:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+19:18615:x1870627099310080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969489.855715:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+19:18615:x1870627099310080:12345-0@lo:501:mount.lustre.0 Request processed in 181us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969489.855723:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783969489.855800:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969489.855831:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310208:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969489.855884:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.856127:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969489.856199:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099310208 00000100:00100000:1.0:1783969489.856205:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099310208 00000100:00100000:1.0:1783969489.856230:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783969489.856237:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+19:18615:x1870627099310208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969489.857414:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+19:18615:x1870627099310208:12345-0@lo:503:mount.lustre.0 Request processed in 1172us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969489.857434:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783969489.857546:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310208:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783969489.858010:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783969489.858104:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969489.858153:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.858180:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5300 going to sleep for 11 seconds 00000100:00100000:1.0:1783969489.858686:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099310336 00000100:00100000:1.0:1783969489.858694:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099310336 00000100:00100000:1.0:1783969489.858727:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783969489.858829:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+19:18615:x1870627099310336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969489.859356:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+19:18615:x1870627099310336:12345-0@lo:502:mount.lustre.0 Request processed in 620us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969489.859482:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969489.860093:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1783969489.860125:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1783969489.860138:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1783969489.860150:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1783969489.860162:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1783969489.860173:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1783969489.860185:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1783969489.860197:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1783969489.860209:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1783969489.860221:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1783969489.860233:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1783969489.860245:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1783969489.860277:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969489.860327:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.860353:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969489.860529:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099310464 00000100:00100000:2.0:1783969489.860534:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099310464 00000100:00100000:2.0:1783969489.860563:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783969489.860571:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099310464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969489.860683:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099310464:12345-0@lo:502:mount.lustre.0 Request processed in 111us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969489.860690:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783969489.861121:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783969489.861210:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969489.861263:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1783969489.861274:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1783969489.862326:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783969489.862335:0:18632:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1783969489.862350:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969489.862353:0:18632:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783969489.862360:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783969489.864074:0:18632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93eab612b380) 00000020:00000080:1.0:1783969489.864107:0:18632:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783969489.864122:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783969489.864223:0:18632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93eaa01ec800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783969489.864232:0:18632:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783969489.864238:0:18632:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xea31253a47cbae45 00010000:00010000:1.0:1783969489.868924:0:18632:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1783969489.879254:0:18632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1783969489.885187:0:18632:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1783969489.887313:0:18632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783969489.887326:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969489.887333:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.887335:0:18632:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783969489.887338:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783969489.887341:0:18632:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1783969489.887342:0:18632:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783969489.887344:0:18632:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783969489.887346:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783969489.887348:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.887349:0:18632:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783969489.887351:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969489.887354:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.887356:0:18632:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783969489.887358:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783969489.887366:0:18632:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783969489.887416:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969489.887420:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.887421:0:18632:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783969489.887424:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969489.887427:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.887428:0:18632:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783969489.887431:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783969489.887460:0:18632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969489.887463:0:18632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.887465:0:18632:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783969489.887468:0:18632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1783969489.887640:0:18615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1783969489.887679:0:18615:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783969489.887699:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cbae30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae37 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969489.887717:0:18615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cdf200/0xea31253a47cbae30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae37 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969489.887725:0:18615:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eaa01ec800 from 1 10000000:01000000:3.0:1783969489.887728:0:18615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969489.887764:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969489.887771:0:18615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969489.887782:0:18615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969489.887806:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783969489.887870:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969489.887904:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da540 going to sleep for 11 seconds 00000100:00100000:3.0:1783969489.888506:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099310592 00000100:00100000:3.0:1783969489.888514:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099310592 00000100:00100000:3.0:1783969489.888561:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783969489.888570:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+19:18615:x1870627099310592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969489.888582:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969489.888595:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbae4c expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969489.888619:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbae4c expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969489.888641:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbae4c expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969489.888662:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53c00, rc 0) 00000100:00100000:3.0:1783969489.888704:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099310592:12345-0@lo:101:mount.lustre.0 Request processed in 135us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969489.888712:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783969489.888756:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969489.888769:0:18615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969489.888778:0:18615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969489.891514:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783969489.893134:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969489.893361:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783969489.897338:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783969489.897369:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783969489.897375:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783969489.897659:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969489.897728:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969489.901666:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969489.902634:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099310720 00000100:00100000:0.0:1783969489.902656:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099310720 00000100:00100000:0.0:1783969489.902724:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783969489.902744:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099310720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969489.902960:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099310720:12345-0@lo:501:mount.lustre.0 Request processed in 218us (5232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969489.902970:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783969489.903318:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969489.903410:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969489.903457:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969489.903496:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90dacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969489.903833:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099310848 00000100:00100000:1.0:1783969489.903839:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099310848 00000100:00100000:1.0:1783969489.903869:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783969489.903876:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099310848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969489.903979:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099310848:12345-0@lo:503:mount.lustre.0 Request processed in 103us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969489.903988:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783969489.904106:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783969489.904642:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969489.904723:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969489.905007:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969489.905035:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da540 going to sleep for 11 seconds 00000100:00100000:0.0:1783969489.905892:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099310976 00000100:00100000:0.0:1783969489.905901:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099310976 00000100:00100000:0.0:1783969489.905954:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783969489.905962:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099310976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969489.906091:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099310976:12345-0@lo:502:mount.lustre.0 Request processed in 129us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969489.906099:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783969489.906483:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099310976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783969489.906761:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783969489.906789:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783969489.906801:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783969489.906812:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783969489.906823:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783969489.906836:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783969489.906848:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783969489.906859:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1783969489.906871:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783969489.906882:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1783969489.906893:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1783969489.906947:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969489.906996:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969489.907037:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83e5af00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969489.907204:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099311104 00000100:00100000:2.0:1783969489.907210:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099311104 00000100:00100000:2.0:1783969489.907260:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783969489.907268:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099311104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969489.907360:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099311104:12345-0@lo:502:mount.lustre.0 Request processed in 92us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969489.907366:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783969489.908699:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783969489.908796:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1783969489.908809:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783969489.911069:0:18636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969489.911081:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.911083:0:18636:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783969489.911090:0:18636:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93eaa01ec800 00000020:00000080:1.0:1783969489.911093:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783969489.911101:0:18636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969489.911103:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.911104:0:18636:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783969489.911106:0:18636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969489.911109:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.911110:0:18636:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783969489.911113:0:18636:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93eaa01ec800 00000020:00000080:1.0:1783969489.911115:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783969489.911176:0:18636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969489.911180:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.911181:0:18636:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783969489.911183:0:18636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969489.911185:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.911186:0:18636:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783969489.911189:0:18636:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93eaa01ec800 00000020:00000080:1.0:1783969489.911192:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783969489.911207:0:18636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969489.911210:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.911212:0:18636:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783969489.911214:0:18636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969489.911223:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.911225:0:18636:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783969489.911229:0:18636:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93eaa01ec800 00000020:00000080:1.0:1783969489.911232:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783969489.911254:0:18636:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969489.911257:0:18636:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969489.911259:0:18636:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783969489.911262:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1783969489.911448:0:18615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783969489.911477:0:18615:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969489.911502:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969489.911512:0:18615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969489.911565:0:18615:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783969489.911568:0:18615:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93eaa01ec800 10000000:01000000:0.0:1783969489.911570:0:18615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93eaa01ec800 10000000:01000000:0.0:1783969489.911574:0:18615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783969489.911579:0:18615:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93eaa01ec800 from 1 10000000:01000000:0.0:1783969489.911581:0:18615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783969489.912053:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cbae5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969489.912063:0:18615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cbae5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969489.912083:0:18615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cbae5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969489.912107:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311232:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783969489.912169:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.912204:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5180 going to sleep for 11 seconds 00000100:00100000:1.0:1783969489.921192:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099311232 00000100:00100000:1.0:1783969489.921206:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099311232 00000100:00100000:1.0:1783969489.921279:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783969489.921290:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+20:18615:x1870627099311232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969489.921307:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969489.921326:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983de6c00/0xea31253a47cbae61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbae5a expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969489.921354:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de6c00/0xea31253a47cbae61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbae5a expref: 21 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969489.921393:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983de6c00/0xea31253a47cbae61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbae5a expref: 21 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969489.921402:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6c00, rc 0) 00000100:00100000:1.0:1783969489.921482:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311232:12345-0@lo:101:mount.lustre.0 Request processed in 193us (9312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969489.921488:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783969489.921642:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969489.921671:0:18615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cbae5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae61 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969489.921681:0:18615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cbae5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbae61 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969489.931450:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1783969489.931791:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969489.932002:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783969489.932026:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783969489.932039:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783969489.932052:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783969489.932064:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783969489.932077:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783969489.932089:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783969489.932102:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783969489.932113:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783969489.932124:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783969489.932135:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783969489.932145:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783969489.932156:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783969489.932167:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783969489.932199:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783969489.932215:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783969489.932227:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783969489.932239:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783969489.932250:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783969489.932263:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783969489.932274:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783969489.932286:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783969489.932298:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783969489.932311:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783969489.932322:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1783969489.932334:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1783969489.932346:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1783969489.932358:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1783969489.932369:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1783969489.932407:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1783969489.932434:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1783969489.932448:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1783969489.932460:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1783969489.932472:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1783969489.932484:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1783969489.932498:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1783969489.932511:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1783969489.932529:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1783969489.932534:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1783969489.932619:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969489.932694:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.932737:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969489.932895:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099311360 00000100:00100000:1.0:1783969489.932902:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099311360 00000100:00100000:1.0:1783969489.932956:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783969489.932966:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969489.933089:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311360:12345-0@lo:501:mount.lustre.0 Request processed in 124us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969489.933097:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783969489.937064:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969489.937121:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969489.937197:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.937244:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969489.937265:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099311488 00000100:00100000:0.0:1783969489.937272:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099311488 00000100:00100000:0.0:1783969489.937322:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783969489.937332:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311488:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969489.937463:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311488:12345-0@lo:503:mount.lustre.0 Request processed in 131us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969489.937471:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783969489.937521:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311488:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783969489.939484:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783969489.939574:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969489.939642:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.939692:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074480 going to sleep for 11 seconds 00000100:00100000:0.0:1783969489.939716:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099311616 00000100:00100000:0.0:1783969489.939721:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099311616 00000100:00100000:0.0:1783969489.942078:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783969489.942095:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969489.942246:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311616:12345-0@lo:502:mount.lustre.0 Request processed in 156us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969489.942254:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783969489.942309:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969489.942560:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783969489.942590:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783969489.942604:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783969489.942617:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783969489.942638:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783969489.948355:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783969489.948448:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783969489.948465:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783969489.948478:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783969489.948491:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783969489.948505:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783969489.948518:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783969489.948531:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783969489.948543:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783969489.948555:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783969489.948567:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783969489.948579:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783969489.948591:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783969489.948604:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783969489.948617:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783969489.948630:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783969489.948642:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783969489.948680:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783969489.948698:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783969489.948713:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1783969489.948726:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1783969489.948752:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1783969489.948767:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1783969489.948780:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1783969489.948793:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1783969489.948803:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1783969489.948815:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1783969489.948828:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1783969489.948840:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1783969489.948854:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1783969489.948866:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1783969489.948878:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1783969489.948903:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1783969489.948929:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1783969489.948943:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1783969489.948956:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1783969489.948969:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1783969489.948983:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1783969489.948995:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1783969489.949007:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1783969489.949019:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1783969489.949031:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1783969489.949042:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1783969489.949102:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969489.949177:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.949220:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea880c5180 going to sleep for 11 seconds 00000100:00100000:0.0:1783969489.949254:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099311744 00000100:00100000:0.0:1783969489.949261:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099311744 00000100:00100000:0.0:1783969489.949305:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783969489.949313:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea90984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969489.949451:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea90984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311744:12345-0@lo:502:mount.lustre.0 Request processed in 138us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969489.949460:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783969489.949511:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969489.949697:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1783969489.949719:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1783969489.949742:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969489.949774:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969489.949783:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074480 going to sleep for 11 seconds 00000100:00100000:0.0:1783969489.949802:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099311872 00000100:00100000:0.0:1783969489.949811:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099311872 00000100:00100000:0.0:1783969489.949830:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783969489.949836:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969489.949896:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099311872:12345-0@lo:502:mount.lustre.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969489.949903:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783969489.949931:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099311872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969489.949962:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1783969489.949969:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783969489.959929:0:18641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783969489.959948:0:18641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93eab6128000) 00000020:00000080:1.0:1783969489.959974:0:18641:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1783969489.969255:0:18641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93eaa01ec800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783969489.969266:0:18641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93eaa01ec800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783969489.969270:0:18641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eaa01ec800 3 00010000:00080000:1.0:1783969489.969309:0:18641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eaa5b1e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1783969489.973843:0:18641:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1783969489.973962:0:18641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783969489.974013:0:18641:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783969489.974030:0:18641:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xea31253a47cbae6f 00000100:00080000:1.0:1783969489.974042:0:18641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783969489.974049:0:18641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93eaa5b1e000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969489.974090:0:18641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea867b3100 x1870627099312000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969489.980958:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1870627099312000:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969489.981038:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783969489.981144:0:18641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783969489.981206:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969489.981210:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969489.981213:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969489.981217:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969489.981238:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969489.981242:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969489.981258:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969489.981261:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783969489.981302:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099312128:0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.981333:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969489.981356:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969489.981362:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099312256:0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.981399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969489.981431:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099312384:0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.981452:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969489.981467:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969489.981473:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099312512:0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.981493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969489.981527:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099312128 00000100:00100000:1.0:1783969489.981533:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099312128 00000100:00100000:1.0:1783969489.981568:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099312384 00000100:00100000:1.0:1783969489.981571:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099312384 00000100:00100000:1.0:1783969489.981586:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969489.981593:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099312128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.981641:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099312128:12345-0@lo:400:kworker.0 Request processed in 47us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969489.981661:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969489.981677:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969489.981683:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099312384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.981711:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099312384:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969489.981726:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969489.985913:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099312000 00000100:00100000:1.0:1783969489.985930:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099312000 00000100:00100000:1.0:1783969489.985958:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099312256 00000100:00100000:1.0:1783969489.985960:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099312256 00000100:00100000:1.0:1783969489.985983:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099312512 00000100:00100000:1.0:1783969489.985986:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099312512 00000100:00100000:1.0:1783969489.986003:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783969489.986013:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099312256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.986097:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099312256:12345-0@lo:400:kworker.0 Request processed in 84us (4696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969489.986104:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783969489.986119:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969489.986125:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099312512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.986151:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099312512:12345-0@lo:400:kworker.0 Request processed in 26us (4658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969489.986157:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969489.986166:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969489.986171:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1870627099312000:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783969489.986192:0:17113:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1783969489.986262:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xea31253a47cbae76 00000004:00100000:1.0:1783969489.986279:0:17113:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783969489.986311:0:17113:0:(import.c:65:import_set_state_nolock()) ffff93ea91e17000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969489.999057:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870627099312000:12345-0@lo:38:llog_process_th.0 Request processed in 12871us (18005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969489.999072:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783969489.999183:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93eabf850380 x1870627099312512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969489.999199:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099312512:0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.999212:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099312384:0@lo:400:kworker.0 00010000:00080000:1.0:1783969489.999252:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93eabf850700 x1870627099312256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969489.999261:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099312256:0@lo:400:kworker.0 00000100:00100000:1.0:1783969489.999272:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099312128:0@lo:400:kworker.0 00000020:01000004:0.0:1783969489.999492:0:18641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783969489.999512:0:18641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93eaa5b00000) 00000020:00000080:0.0:1783969489.999536:0:18641:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1783969490.000034:0:18641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93eaa01ec800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783969490.000039:0:18641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93eaa01ec800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783969490.000041:0:18641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eaa01ec800 3 00010000:00080000:0.0:1783969490.000072:0:18641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93eaabc0d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969490.001630:0:18641:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1783969490.001771:0:18641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1783969490.001817:0:18641:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783969490.001832:0:18641:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xea31253a47cbae84 00000100:00080000:0.0:1783969490.001844:0:18641:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969490.001849:0:18641:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93eaabc0d000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969490.001882:0:18641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf747480 x1870627099312640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783969490.001899:0:18641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783969490.002750:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969490.002757:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969490.002760:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969490.002763:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969490.002767:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969490.002770:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969490.002773:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969490.002776:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1783969490.003321:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ea867b3100 x1870627099312000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969490.003334:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969490.003343:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783969490.003358:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783969490.003362:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783969490.003366:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eaa5b1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783969490.003374:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1870627099312000:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969490.003426:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1870627099312640:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969490.003513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969490.006887:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099312640 00000100:00100000:1.0:1783969490.006902:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099312640 00000100:00100000:1.0:1783969490.006941:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969490.006949:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099312640:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783969490.006980:0:17112:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1783969490.007015:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xea31253a47cbae8b 00000004:00100000:1.0:1783969490.007040:0:17112:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783969490.007077:0:17112:0:(import.c:65:import_set_state_nolock()) ffff93e9837e5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969490.007177:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870627099312640:12345-0@lo:38:llog_process_th.0 Request processed in 227us (3663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969490.007184:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1783969490.007624:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:3.0:1783969490.009089:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93eabf747480 x1870627099312640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969490.009104:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783969490.009113:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1783969490.009122:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783969490.009128:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783969490.009132:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eaabc0d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783969490.009138:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1870627099312640:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1783969490.014550:0:18615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783969490.014598:0:18615:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969490.014622:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cbae5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae61 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.014635:0:18615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea89cde000/0xea31253a47cbae5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbae61 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783969490.014702:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783969490.014704:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783969490.014705:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969490.014706:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969490.014707:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969490.014709:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969490.014710:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969490.014712:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969490.014714:0:18615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783969490.014718:0:18615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1783969490.014720:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783969490.014722:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783969490.014723:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969490.014724:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969490.014725:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969490.014725:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969490.014726:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969490.014727:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969490.014728:0:18615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783969490.014767:0:18615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783969490.014790:0:18615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099312768:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783969490.014870:0:18615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969490.014908:0:18615:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea85549600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969490.015466:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099312768 00000100:00100000:2.0:1783969490.015474:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099312768 00000100:00100000:2.0:1783969490.015526:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783969490.015535:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:18615:x1870627099312768:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783969490.015562:0:17106:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783969490.015576:0:17106:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783969490.025281:0:17106:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783969490.025303:0:17106:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1783969490.025459:0:17128:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783969490.025465:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783969490.025495:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.025516:0:17128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbadd5 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.025525:0:17128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbade3 expref: 21 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.025533:0:17128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.025574:0:17128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbade3 expref: 21 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.025588:0:17128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbade3 expref: 21 pid: 17106 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969490.025603:0:17128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099312896:0@lo:104: 00000100:00100000:1.0:1783969490.025674:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969490.025725:0:17128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbadd5 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.025738:0:17128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbadd5 expref: 21 pid: 17105 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969490.025747:0:17128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099313024:0@lo:104: 00000100:00100000:1.0:1783969490.025788:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969490.025812:0:17128:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea83e5a840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969490.025901:0:17096:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783969490.025920:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099312896 00000100:00100000:0.0:1783969490.025932:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099312896 00000100:00100000:0.0:1783969490.025965:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099313024 00000100:00100000:0.0:1783969490.025968:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099313024 00000100:00100000:0.0:1783969490.025981:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969490.025990:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+4:17128:x1870627099312896:12345-0@lo:104: 00010000:00010000:0.0:1783969490.026001:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026062:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969490.026068:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+4:17128:x1870627099312896:12345-0@lo:104: Request processed in 80us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969490.026075:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969490.026090:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969490.026095:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab201f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+3:17128:x1870627099313024:12345-0@lo:104: 00010000:00010000:0.0:1783969490.026102:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026130:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969490.026135:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab201f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+3:17128:x1870627099313024:12345-0@lo:104: Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969490.026140:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783969490.026175:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969490.026180:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026187:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde800 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969490.026190:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026208:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969490.026215:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969490.026221:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969490.026251:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026257:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969490.026278:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026285:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cde800/0xea31253a47cbade3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbadea expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026298:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969490.026300:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026305:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdec00 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969490.026307:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026313:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969490.026318:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969490.026330:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969490.026343:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026348:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969490.026356:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026361:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea89cdec00/0xea31253a47cbadd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaddc expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026371:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969490.026373:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969490.026374:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969490.026414:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969490.026425:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099313152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969490.026453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969490.026490:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969490.026496:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099313280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969490.026520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969490.026551:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099313152 00000100:00100000:0.0:1783969490.026555:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099313152 00010000:00010000:0.0:1783969490.026570:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbade3 expref: 22 pid: 17106 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969490.026588:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099313280 00000100:00100000:0.0:1783969490.026590:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099313280 00010000:00010000:0.0:1783969490.026598:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbadd5 expref: 23 pid: 17105 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969490.026624:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969490.026630:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:451c11fa-8d33-493c-b495-458f5de7342a+23:3646:x1870627099313152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969490.026640:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969490.026655:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbade3 expref: 23 pid: 17106 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026665:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbade3 expref: 23 pid: 17106 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026681:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969490.026708:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:451c11fa-8d33-493c-b495-458f5de7342a+23:3646:x1870627099313152:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969490.026714:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969490.026726:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969490.026731:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:451c11fa-8d33-493c-b495-458f5de7342a+22:3646:x1870627099313280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969490.026739:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969490.026742:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbadd5 expref: 22 pid: 17105 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026750:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbadd5 expref: 22 pid: 17105 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026760:0:17099:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026767:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783969490.026787:0:17099:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002745866s 00010000:00010000:0.0:1783969490.026792:0:17099:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026799:0:17099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026807:0:17099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026814:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026819:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de7200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969490.026823:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026833:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026841:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.026850:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969490.026871:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:451c11fa-8d33-493c-b495-458f5de7342a+22:3646:x1870627099313280:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969490.026878:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969490.026934:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099313280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969490.026944:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099313152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969490.027282:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea83dafc00/0xea31253a47cbadea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbade3 expref: 21 pid: 17106 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969490.027296:0:17128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099312896:0@lo:104: 00010000:00010000:1.0:1783969490.027305:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e983de7c00/0xea31253a47cbaddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbadd5 expref: 20 pid: 17105 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969490.027313:0:17128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099313024:0@lo:104: 00010000:00010000:1.0:1783969490.027326:0:17128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.027335:0:17128:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.027342:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.027348:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e983de7200/0xea31253a47cbae92 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969490.028817:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+19:18615:x1870627099312768:12345-0@lo:253:mount.lustre.0 Request processed in 13276us (13939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969490.028831:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783969490.028929:0:18615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:18615:1870627099312768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783969490.028944:0:18615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783969490.028948:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783969490.028950:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783969490.028952:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969490.028953:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969490.028954:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969490.028956:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969490.028957:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969490.028972:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969490.028974:0:18615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783969490.028990:0:18615:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1783969490.052727:0:18615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1783969490.057258:0:18615:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783969490.057269:0:18615:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783969490.060205:0:18615:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783969490.060262:0:18615:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783969490.060291:0:18615:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783969490.060323:0:18615:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1783969490.061673:0:18615:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969490.061909:0:18615:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783969490.166834:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969491.186344:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783969491.246471:0:18694:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969491.246702:0:18694:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1783969491.825481:0:17109:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783969491.825489:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93e9835eb000 from 9 10000000:01000000:3.0:1783969491.825496:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783969491.825548:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969491.825560:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969491.825571:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969491.825608:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099313408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969491.825702:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969491.825752:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da480 going to sleep for 11 seconds 00000100:00100000:2.0:1783969491.825888:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099313408 00000100:00100000:2.0:1783969491.825896:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099313408 00000100:00100000:2.0:1783969491.825954:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783969491.825964:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+19:17109:x1870627099313408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969491.825978:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969491.825993:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbae99 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969491.826017:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbae99 expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969491.826027:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbae99 expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969491.826043:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea83daea00, rc 0) 00000100:00100000:2.0:1783969491.826083:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:17109:x1870627099313408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969491.826090:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783969491.826312:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099313408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969491.826327:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969491.826337:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969491.826405:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099313536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783969491.826436:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969491.826466:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da480 going to sleep for 11 seconds 00000100:00100000:2.0:1783969491.826513:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099313536 00000100:00100000:2.0:1783969491.826517:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099313536 00000100:00100000:2.0:1783969491.826548:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783969491.826554:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+20:17109:x1870627099313536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783969491.826567:0:17106:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783969491.826581:0:17106:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783969491.826585:0:17106:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1783969491.826669:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+20:17109:x1870627099313536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969491.826677:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783969491.826882:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099313536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783969491.826942:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969491.826949:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969491.826957:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969491.826966:0:17109:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783969491.826968:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93e98330a000 from 9 10000000:01000000:3.0:1783969491.826970:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783969491.826990:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969491.827007:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969491.827015:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969491.827028:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099313664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969491.827054:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969491.827079:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da480 going to sleep for 11 seconds 00000100:00100000:1.0:1783969491.827125:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099313664 00000100:00100000:1.0:1783969491.827130:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099313664 00000100:00100000:1.0:1783969491.827161:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783969491.827169:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+20:17109:x1870627099313664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969491.827177:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969491.827186:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbaea7 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969491.827203:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbaea7 expref: 21 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969491.827212:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbaea7 expref: 21 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969491.827219:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6400, rc 0) 00000100:00100000:1.0:1783969491.827254:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+21:17109:x1870627099313664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969491.827260:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783969491.827321:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099313664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969491.827331:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969491.827339:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969491.827373:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099313792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783969491.827432:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969491.827442:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da480 going to sleep for 11 seconds 00000100:00100000:1.0:1783969491.827486:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099313792 00000100:00100000:1.0:1783969491.827490:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099313792 00000100:00100000:1.0:1783969491.827519:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783969491.827531:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+21:17109:x1870627099313792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783969491.827543:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783969491.827553:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783969491.827556:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1783969491.827630:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+21:17109:x1870627099313792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969491.827638:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783969491.827722:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099313792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783969491.827763:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969491.827769:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969491.827776:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969492.211806:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969492.337538:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969492.337566:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099313920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969492.337653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969492.337719:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099313920 00000100:00100000:3.0:1783969492.337726:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099313920 00000100:00100000:3.0:1783969492.337773:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969492.337781:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099313920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969492.337814:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783969492.337857:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099313920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969492.337865:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969492.337907:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099313920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969492.849425:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099314048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969492.849504:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969492.849789:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099314048 00000100:00100000:1.0:1783969492.849797:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099314048 00000100:00100000:1.0:1783969492.849853:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783969492.849864:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099314048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969492.849905:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783969492.849953:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099314048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969492.849961:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969492.850630:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099314048:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783969493.241250:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969494.256849:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783969494.645851:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783969495.284269:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783969495.412161:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969495.412168:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969495.412171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969495.412175:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969495.412199:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969495.412202:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969495.412205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969495.412214:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783969495.412257:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099314432:0@lo:400:kworker.0 00000100:00100000:3.0:1783969495.412323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969495.412354:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099314944:0@lo:400:kworker.0 00000100:00100000:3.0:1783969495.412375:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969495.412415:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969495.412422:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099314560:0@lo:400:kworker.0 00000100:00100000:3.0:1783969495.412447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969495.412531:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099314176:0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.412580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969495.412617:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099314688:0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.412639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969495.412658:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783969495.412663:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099314304:0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.412684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969495.412700:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099314816:0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.412722:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969495.412750:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099314560 00000100:00100000:0.0:1783969495.412756:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099314560 00000100:00100000:0.0:1783969495.412794:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099314304 00000100:00100000:0.0:1783969495.412797:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099314304 00000100:00100000:0.0:1783969495.412814:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969495.412823:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099314560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.412874:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099314560:12345-0@lo:400:kworker.0 Request processed in 51us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969495.412882:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969495.412898:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783969495.412904:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099314304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.412931:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099314304:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969495.412945:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783969495.412978:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099314432 00000100:00100000:0.0:1783969495.412982:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099314432 00000100:00100000:0.0:1783969495.412998:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099314944 00000100:00100000:0.0:1783969495.413000:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099314944 00000100:00100000:0.0:1783969495.413018:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099314688 00000100:00100000:0.0:1783969495.413021:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099314688 00000100:00100000:0.0:1783969495.413030:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099314816 00000100:00100000:0.0:1783969495.413033:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099314816 00000100:00100000:0.0:1783969495.413046:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969495.413052:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099314432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.413080:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870627099314432:12345-0@lo:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969495.413087:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969495.413098:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969495.413104:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099314944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.413126:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099314944:12345-0@lo:400:kworker.0 Request processed in 23us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969495.413131:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969495.413140:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783969495.413146:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099314688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.413168:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099314688:12345-0@lo:400:kworker.0 Request processed in 23us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969495.413174:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783969495.413183:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969495.413188:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099314816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.413223:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099314816:12345-0@lo:400:kworker.0 Request processed in 34us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969495.413229:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969495.413269:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099314304:0@lo:400:kworker.0 00010000:00080000:0.0:1783969495.413282:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e983d21f80 x1870627099314816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969495.413292:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099314816:0@lo:400:kworker.0 00010000:00080000:0.0:1783969495.413301:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e983d22a00 x1870627099314688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969495.413309:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099314688:0@lo:400:kworker.0 00000100:00100000:0.0:1783969495.413335:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099314560:0@lo:400:kworker.0 00010000:00080000:0.0:1783969495.413344:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e983d21500 x1870627099314432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969495.413351:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870627099314432:0@lo:400:kworker.0 00010000:00080000:0.0:1783969495.413363:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e983d20a80 x1870627099314944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969495.413371:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099314944:0@lo:400:kworker.0 00000100:00080000:1.0:1783969495.413569:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969495.413574:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969495.414009:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099314176 00000100:00100000:3.0:1783969495.414016:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099314176 00000100:00100000:3.0:1783969495.414057:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783969495.414063:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+21:3646:x1870627099314176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969495.414114:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+21:3646:x1870627099314176:12345-0@lo:400:kworker.0 Request processed in 51us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969495.414120:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783969495.414285:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099314176:0@lo:400:kworker.0 00000100:00100000:2.0:1783969496.179929:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969481/real 1783969481] req@ffff93e98319c700 x1870627099307392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969496 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969496.180132:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93e98319c700 x1870627099307392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969496 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969496.180144:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969481/real 1783969481] req@ffff93e98319e680 x1870627099307520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969496 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969496.180156:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93e98319e680 x1870627099307520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969496 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783969496.180193:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e9835e9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969496.180268:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783969496.180273:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099307392:0@lo:8:kworker.0 00000100:00080000:2.0:1783969496.180279:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969496.183992:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969496.183998:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969496.184001:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969496.184005:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969496.184018:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969496.184021:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783969496.184025:0:38:0:(import.c:65:import_set_state_nolock()) ffff93e9835e9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969496.184034:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1783969496.184039:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783969496.184053:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93e9835e9000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969496.184075:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf853480 x1870627099315584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783969496.184088:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969496.184090:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783969496.184092:0:38:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969496.184095:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1783969496.184097:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783969496.184102:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93ea8325a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969496.184111:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf853b80 x1870627099315712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969496.184273:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:451c11fa-8d33-493c-b495-458f5de7342a:3649:1870627099315072:0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.184346:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969496.184502:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099315840:0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.184540:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969496.184577:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969496.184583:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099315456:0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.184609:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969496.184635:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099315200:0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.184656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969496.184671:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099315968:0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.184688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969496.184703:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783969496.184708:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099315328:0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.184726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969496.184740:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099316096:0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.184759:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969496.184781:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099315840 00000100:00100000:0.0:1783969496.184788:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099315840 00000100:00100000:0.0:1783969496.184904:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099315968 00000100:00100000:0.0:1783969496.184907:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099315968 00000100:00100000:0.0:1783969496.184921:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099315328 00000100:00100000:0.0:1783969496.184923:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099315328 00000100:00100000:0.0:1783969496.184932:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099316096 00000100:00100000:0.0:1783969496.184935:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099316096 00000100:00100000:0.0:1783969496.185010:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969496.185021:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099315840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.185070:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099315840:12345-0@lo:400:kworker.0 Request processed in 50us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969496.185076:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969496.185092:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783969496.185104:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099315968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.185135:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099315968:12345-0@lo:400:kworker.0 Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969496.185141:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783969496.185153:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969496.185158:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099315328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.185183:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099315328:12345-0@lo:400:kworker.0 Request processed in 24us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969496.185188:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969496.185198:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783969496.185204:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099316096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.185229:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099316096:12345-0@lo:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969496.185235:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783969496.185253:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099315456 00000100:00100000:0.0:1783969496.185256:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099315456 00000100:00100000:0.0:1783969496.185276:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099315200 00000100:00100000:0.0:1783969496.185278:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099315200 00000100:00100000:0.0:1783969496.185288:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783969496.185294:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099315456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.185323:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099315456:12345-0@lo:400:kworker.0 Request processed in 29us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969496.185330:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783969496.185341:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783969496.185346:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099315200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.185370:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099315200:12345-0@lo:400:kworker.0 Request processed in 24us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969496.185403:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783969496.186156:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099315456:0@lo:400:kworker.0 00010000:00080000:0.0:1783969496.186172:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf850a80 x1870627099315840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969496.186183:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099315840:0@lo:400:kworker.0 00010000:00080000:0.0:1783969496.186217:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf850700 x1870627099315328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969496.186227:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099315328:0@lo:400:kworker.0 00010000:00080000:0.0:1783969496.186236:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf852300 x1870627099316096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969496.186245:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099316096:0@lo:400:kworker.0 00000100:00100000:0.0:1783969496.186253:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099315200:0@lo:400:kworker.0 00010000:00080000:0.0:1783969496.186261:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf853800 x1870627099315968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969496.186269:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099315968:0@lo:400:kworker.0 00000100:00100000:1.0:1783969496.188970:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099315072 00000100:00100000:1.0:1783969496.188984:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099315072 00000100:00100000:1.0:1783969496.189042:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783969496.189053:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:3649:x1870627099315072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969496.189150:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:3649:x1870627099315072:12345-0@lo:400:kworker.0 Request processed in 98us (4803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969496.189158:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783969496.189222:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:451c11fa-8d33-493c-b495-458f5de7342a:3649:1870627099315072:0@lo:400:kworker.0 00000100:00080000:2.0:1783969496.190739:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783969496.190748:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099307520:0@lo:8:kworker.0 00000100:00100000:2.0:1783969496.190787:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099315584:0@lo:8:kworker.0 00000100:00080000:1.0:1783969496.191057:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969496.191062:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969496.191065:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969496.191068:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783969496.191155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969496.191198:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099315712:0@lo:8:kworker.0 00000100:00100000:2.0:1783969496.191223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969496.191624:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099315584 00000100:00100000:1.0:1783969496.191638:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099315584 00000100:00100000:1.0:1783969496.191669:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099315712 00000100:00100000:1.0:1783969496.191671:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099315712 00000100:00100000:1.0:1783969496.191685:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969496.191692:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099315584:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783969496.191723:0:18620:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:1.0:1783969496.191752:0:18620:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cbaeb5 00002000:00100000:1.0:1783969496.191767:0:18620:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93ea86fc8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1783969496.191770:0:18620:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1783969496.191773:0:18620:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783969496.193132:0:18620:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1783969496.193164:0:18620:0:(import.c:65:import_set_state_nolock()) ffff93ea86fca800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969496.193236:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1870627099315584:12345-0@lo:8:kworker.0 Request processed in 1542us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969496.193246:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969496.193269:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969496.193275:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099315712:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783969496.193292:0:18620:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1783969496.193989:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabf853480 x1870627099315584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969496.194002:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969496.194010:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783969496.194018:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783969496.194024:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783969496.194026:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e9835e9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783969496.194042:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783969496.194047:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099315584:0@lo:8:kworker.0 00000004:00080000:0.0:1783969496.194191:0:17855:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783969496.194262:0:17855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 558321880391ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783969496.194269:0:17855:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1783969496.194468:0:17856:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783969496.194489:0:17856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1870627099316352:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1783969496.194532:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969496.194564:0:17856:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86ffc900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969496.194597:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099316224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969496.194625:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969496.194662:0:18621:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783969496.194669:0:18621:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783969496.194765:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099316352 00000100:00100000:0.0:1783969496.194771:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099316352 00000100:00100000:0.0:1783969496.199929:0:18923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969496.200039:0:18923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17856:x1870627099316352:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1783969496.209040:0:18923:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783969496.209053:0:18923:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1783969496.209165:0:18923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17856:x1870627099316352:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9219us (14627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969496.209177:0:18923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783969496.209443:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e983d20a80 x1870627099316352/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783969512 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969496.209459:0:17856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1870627099316352:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1783969496.209475:0:17856:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1783969496.209559:0:17856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983eff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1870627099316480:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783969496.209603:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969496.209627:0:17856:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eabc1f36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969496.209664:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099316480 00000100:00100000:2.0:1783969496.209671:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099316480 00000100:00100000:2.0:1783969496.209709:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969496.209718:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17856:x1870627099316480:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1783969496.209744:0:18621:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1783969496.209777:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17856:x1870627099316480:12345-0@lo:5:osp-pre-0-1.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969496.209782:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783969496.209825:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e983eff100 x1870627099316480/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969512 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969496.209834:0:17856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983eff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1870627099316480:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783969496.209842:0:17856:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1783969496.212476:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099316224 00000100:00100000:0.0:1783969496.212489:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099316224 00000100:00100000:0.0:1783969496.212538:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969496.212560:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870627099316224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969496.212593:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783969496.212670:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870627099316224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (18044us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969496.212678:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783969496.212720:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e983d20e00 x1870627099316224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969496.212741:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099316224:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1783969496.218328:0:17846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:1.0:1783969496.223105:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969496.223203:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099315712:12345-0@lo:8:kworker.0 Request processed in 29922us (31974us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783969496.223217:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783969496.223274:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969496.223280:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783969496.223285:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099315712:0@lo:8:kworker.0 00010000:00010000:0.0:1783969496.305580:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969497.333680:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783969497.368355:0:18985:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783969497.457515:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969497.457549:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099316608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969497.457626:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969497.457673:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099316608 00000100:00100000:3.0:1783969497.457681:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099316608 00000100:00100000:3.0:1783969497.457849:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783969497.457859:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099316608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969497.457893:0:17854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783969497.457936:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099316608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969497.457944:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783969497.458011:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099316608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969497.968628:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099316736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969497.968707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969497.968832:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099316736 00000100:00100000:2.0:1783969497.968839:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099316736 00000100:00100000:2.0:1783969497.968892:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783969497.968901:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099316736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969497.968931:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783969497.968978:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099316736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969497.968985:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783969497.969128:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099316736:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783969498.366408:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783969498.552046:0:19037:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783969498.552327:0:19037:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1783969498.737804:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783969499.377329:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783969499.744949:0:19087:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783969499.745850:0:19087:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783969500.272583:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969480/real 1783969480] req@ffff93e98319d880 x1870627099305856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969500 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969500.272641:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93e98319d880 x1870627099305856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969500 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969500.272654:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969480/real 1783969480] req@ffff93e98319df80 x1870627099305984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969500 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969500.272668:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93e98319df80 x1870627099305984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969500 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783969500.272693:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea88952800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969500.272728:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783969500.272733:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099305856:0@lo:8:kworker.0 00000100:00080000:1.0:1783969500.272740:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969500.272746:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783969500.272749:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099305984:0@lo:8:kworker.0 00000100:00080000:3.0:1783969500.273034:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969500.273040:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783969500.273043:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ea88952800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969500.273049:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:3.0:1783969500.273056:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783969500.273064:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ea88952800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969500.273089:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabbff2a00 x1870627099317120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969500.273102:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969500.273105:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783969500.273107:0:8:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969500.273110:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:3.0:1783969500.273113:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783969500.273116:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93eab9286000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969500.273133:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabbff3b80 x1870627099317248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969500.273183:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969500.273187:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783969500.273189:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969500.273193:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 558 00000100:00080000:3.0:1783969500.273195:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783969500.273200:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93ea8325a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969500.273212:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabbff1500 x1870627099317760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969500.273808:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099316864:0@lo:400:kworker.0 00000100:00100000:1.0:1783969500.273909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969500.273985:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099317632:0@lo:400:kworker.0 00000100:00100000:1.0:1783969500.274022:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969500.274052:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783969500.274059:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099317504:0@lo:400:kworker.0 00000100:00100000:1.0:1783969500.274087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969500.274124:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099318144:0@lo:400:kworker.0 00000100:00100000:2.0:1783969500.274308:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099316992:0@lo:400:kworker.0 00000100:00100000:2.0:1783969500.274342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969500.274371:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099317888:0@lo:400:kworker.0 00000100:00100000:2.0:1783969500.274440:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099317376:0@lo:400:kworker.0 00000100:00100000:2.0:1783969500.274499:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099317504 00000100:00100000:2.0:1783969500.274507:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099317504 00000100:00100000:2.0:1783969500.274562:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099316992 00000100:00100000:2.0:1783969500.274565:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099316992 00000100:00100000:2.0:1783969500.274584:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969500.274610:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099317504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969500.274676:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099317504:12345-0@lo:400:kworker.0 Request processed in 69us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969500.274684:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969500.274705:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783969500.274711:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099316992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969500.274745:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099316992:12345-0@lo:400:kworker.0 Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969500.274751:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783969500.275647:0:18923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099317632 00000100:00100000:0.0:1783969500.275658:0:18923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099317632 00000100:00100000:0.0:1783969500.275740:0:18923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969500.275749:0:18923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3647:x1870627099317632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969500.275824:0:18923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3647:x1870627099317632:12345-0@lo:400:kworker.0 Request processed in 76us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969500.275832:0:18923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969500.275895:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099317120:0@lo:8:kworker.0 00000100:00100000:0.0:1783969500.275937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969500.275984:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099317248:0@lo:8:kworker.0 00000100:00100000:0.0:1783969500.276008:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969500.276029:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099317760:0@lo:8:kworker.0 00000100:00100000:0.0:1783969500.276054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969500.276087:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099317120 00000100:00100000:0.0:1783969500.276091:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099317120 00000100:00100000:0.0:1783969500.276108:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099317248 00000100:00100000:0.0:1783969500.276111:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099317248 00000100:00100000:0.0:1783969500.276119:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099317760 00000100:00100000:0.0:1783969500.276121:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099317760 00000100:00100000:0.0:1783969500.276131:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783969500.276135:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099317120:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783969500.276951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783969500.277545:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969500.277707:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969500.277719:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1870627099317248:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783969500.277748:0:18622:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783969500.277854:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1870627099317248:12345-0@lo:8:kworker.0 Request processed in 136us (1844us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783969500.277863:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969500.277888:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969500.277893:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1870627099317760:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783969500.277904:0:18622:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783969500.277950:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1870627099317760:12345-0@lo:8:kworker.0 Request processed in 55us (1894us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783969500.277956:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783969500.278420:0:18620:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:0.0:1783969500.278460:0:18620:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cbaebc 00002000:00100000:0.0:1783969500.278490:0:18620:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93eabf7bb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783969500.278495:0:18620:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783969500.278499:0:18620:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1783969500.278827:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099316864 00000100:00100000:3.0:1783969500.278837:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099316864 00000100:00100000:3.0:1783969500.278896:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783969500.278906:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+21:3647:x1870627099316864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969500.278984:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+21:3647:x1870627099316864:12345-0@lo:400:kworker.0 Request processed in 79us (5074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969500.278991:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783969500.279055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969500.279119:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099316992:0@lo:400:kworker.0 00000100:00100000:3.0:1783969500.279164:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099318144 00000100:00100000:3.0:1783969500.279169:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099318144 00010000:00080000:1.0:1783969500.279494:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff0a80 x1870627099317632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969500.279508:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099317632:0@lo:400:kworker.0 00000100:00100000:1.0:1783969500.279537:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099317504:0@lo:400:kworker.0 00000100:00100000:1.0:1783969500.279548:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099316864:0@lo:400:kworker.0 00000100:00100000:3.0:1783969500.281541:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099317888 00000100:00100000:3.0:1783969500.281561:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099317888 00000100:00100000:2.0:1783969500.281800:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969500.281860:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099318016:0@lo:400:kworker.0 00000100:00100000:2.0:1783969500.281932:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783969500.282103:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969500.282122:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099317376 00000100:00100000:2.0:1783969500.282128:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099317376 00000100:00100000:2.0:1783969500.282160:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099318016 00000100:00100000:2.0:1783969500.282164:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099318016 00000100:00080000:1.0:1783969500.282999:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969500.283009:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783969500.283014:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099317248:0@lo:8:kworker.0 00000100:00080000:1.0:1783969500.283028:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969500.283031:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783969500.283034:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099317760:0@lo:8:kworker.0 00000100:00100000:1.0:1783969500.283080:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783969500.283096:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099318144:12345-0@lo:400:kworker.0 00002000:00080000:0.0:1783969500.283293:0:18620:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783969500.283339:0:18620:0:(import.c:65:import_set_state_nolock()) ffff93eabf7bf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969500.283578:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969500.283608:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099317888:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783969500.283926:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969500.295523:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1870627099317120:12345-0@lo:8:kworker.0 Request processed in 19371us (19570us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969500.295545:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783969500.296441:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff2a00 x1870627099317120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969500.296460:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969500.296474:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783969500.296495:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783969500.296502:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783969500.296506:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea88952800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783969500.296523:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783969500.296533:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099317120:0@lo:8:kworker.0 00000004:00080000:2.0:1783969500.296575:0:17136:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783969500.296723:0:17136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 562424341815ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783969500.296731:0:17136:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1783969500.297184:0:17137:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1783969500.297215:0:17137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17137:1870627099318400:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783969500.297298:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969500.297332:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86ffcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969500.297581:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969500.297914:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099318272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969500.297957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969500.298065:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099318272 00000100:00100000:0.0:1783969500.298073:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099318272 00000100:00100000:0.0:1783969500.298143:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969500.298168:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870627099318272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969500.298440:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783969500.298509:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870627099318272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 344us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969500.298517:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783969500.298811:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e983d20a80 x1870627099318272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969500.298844:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099318272:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783969500.298892:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969500.298909:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099318400 00000100:00100000:0.0:1783969500.298914:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099318400 00000100:00100000:0.0:1783969500.299081:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969500.299089:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17137:x1870627099318400:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783969500.301303:0:17092:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1783969500.305075:0:18622:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1783969500.305087:0:18622:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1783969500.305093:0:18622:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:3.0:1783969500.308577:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099317888:12345-0@lo:400:kworker.0 Request processed in 24975us (29506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969500.308608:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969500.308660:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783969500.308671:0:17113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:3.0:1783969500.308922:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff3100 x1870627099317888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969500.308943:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099317888:0@lo:400:kworker.0 00000100:00100000:3.0:1783969500.309022:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969500.309035:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099317376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969500.309134:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099317376:12345-0@lo:400:kworker.0 Request processed in 104us (27337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969500.309141:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969500.309173:0:17113:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783969500.309550:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969500.309560:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099318016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969500.309618:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099318016:12345-0@lo:400:kworker.0 Request processed in 60us (27685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969500.309625:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783969500.309884:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff2300 x1870627099317376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969500.309898:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099317376:0@lo:400:kworker.0 00010000:00080000:3.0:1783969500.309919:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff0e00 x1870627099318016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969500.309928:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099318016:0@lo:400:kworker.0 00000100:00100000:1.0:1783969500.315974:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099318144:12345-0@lo:400:kworker.0 Request processed in 32859us (39002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969500.315996:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00002000:00010000:0.0:1783969500.321415:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969500.321428:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.321447:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.321452:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.321459:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.322225:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.322242:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.322251:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.322285:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969500.323332:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969500.323342:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.323356:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.323361:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.323367:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.323377:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.323406:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.323414:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.323437:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783969500.324172:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969500.324196:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324212:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cde800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.324217:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324252:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324287:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324296:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b794401/0xea31253a47cbaec3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324329:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.324334:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324341:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdec00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.324344:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324351:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324360:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324367:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d19ac15c/0xea31253a47cbaeca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.324416:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.324418:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.324420:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969500.325184:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969500.325195:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.325212:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.325224:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.325231:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.325244:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.325254:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.325263:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.325353:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969500.327326:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969500.327338:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.327354:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.327359:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.327365:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.327378:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.327407:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.327427:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1783969500.327610:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff1180 x1870627099318144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969500.327634:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099318144:0@lo:400:kworker.0 00010000:00010000:1.0:1783969500.330426:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969500.330444:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.330460:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea89cdee00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.330466:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.330488:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.330511:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.330519:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7f4b23/0xea31253a47cbaed1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.330609:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.330614:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.330622:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.330643:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.330652:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.330663:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.330672:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.330673:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.330675:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969500.336423:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969500.336441:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaed8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969500.336522:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.336839:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969500.337167:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969500.337175:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.337190:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.337194:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.337201:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.337213:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.337222:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.337229:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.337259:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783969500.337436:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969500.337461:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969500.337475:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797c00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969500.337492:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969500.337505:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969500.337546:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969500.337566:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013d8df4b/0xea31253a47cbaedf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969500.337602:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969500.337607:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969500.337609:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969500.338162:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969500.338173:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.338185:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.338189:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.338194:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.338206:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.338216:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.338224:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.338247:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.339224:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.339234:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.339244:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.339249:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.339258:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.339277:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.339284:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee7718ae/0xea31253a47cbaee6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.339319:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.339321:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.339323:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969500.342968:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969500.342983:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.343012:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.343025:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.343032:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.343047:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.343058:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.343067:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.343098:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969500.344564:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783969500.344703:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.344713:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.344725:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.344730:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.344739:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.344758:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.344767:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc9027e9/0xea31253a47cbaeed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.344794:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.344796:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.344799:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969500.345422:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.345437:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.345441:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.345448:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.345461:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.345471:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.345503:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.345941:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.346368:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.346404:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.346438:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.346443:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.346454:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.346477:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.346497:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046f3b7ab/0xea31253a47cbaef4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.346526:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.346528:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.346531:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.350458:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.350486:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.350511:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.350517:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.350526:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.350546:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.350559:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.350566:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.350589:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.351246:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.351259:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.351269:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.351274:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.351283:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.351314:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.351323:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc2e0dab/0xea31253a47cbaefb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.351347:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.351350:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.351352:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.351812:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.351821:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.351833:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.351837:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.351843:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.351868:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.351877:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.351884:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.352345:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783969500.353314:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.353328:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.353346:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.353351:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.353357:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.353373:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.353417:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.353448:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.356422:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969500.356444:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.356463:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dae600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.356469:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.356492:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.356522:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.356531:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aff0124f/0xea31253a47cbaf02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.356954:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.356961:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.356981:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83dafc00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.356985:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.356993:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.357006:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.357014:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.357016:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.357019:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969500.362420:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783969500.362436:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088323559/0xea31253a47cbaf09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969500.363189:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.363197:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363212:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.363216:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.363223:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363237:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363247:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363255:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363282:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783969500.363615:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.363621:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363630:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.363634:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.363637:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363647:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363655:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363662:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.363670:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783969500.363789:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969500.363805:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363819:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.363824:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363855:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363882:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363891:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea8aad8e/0xea31253a47cbaf10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363917:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.363921:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363927:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bc000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.363930:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363937:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363948:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363955:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049aa383a/0xea31253a47cbaf17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.363995:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.363997:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.363999:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.364012:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.364067:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.364074:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.364084:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.364094:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.364099:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.364108:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.364116:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.364123:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.364142:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.364707:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.364715:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.364724:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bde00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.364728:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.364736:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.364749:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.364756:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4048eea/0xea31253a47cbaf1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.364773:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.364774:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.364776:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.365145:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.365154:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.365165:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.365169:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.365174:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.365185:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.365194:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.365208:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.365229:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.365309:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.365318:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.365341:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bd000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.365345:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.365353:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.365367:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.365375:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000860b18bc/0xea31253a47cbaf25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.365419:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.365421:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.365423:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.366151:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.366161:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.366173:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.366177:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.366182:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.366193:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.366203:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.366211:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.366233:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.366316:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.366327:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.366336:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bd800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.366341:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.366350:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.366377:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.366418:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae8327d3/0xea31253a47cbaf2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.366440:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.366442:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.366444:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.367547:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.367558:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.367587:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.367591:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.367597:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.367610:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.367619:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.367628:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.367649:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.367688:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.367700:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.367711:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bd200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.367716:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.367727:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.367747:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.367754:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002100ed7/0xea31253a47cbaf33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.367800:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.367802:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.367804:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.369550:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.369562:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.369630:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.369634:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.369640:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.369653:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.369678:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.369685:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.369705:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.369961:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.369985:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.369998:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bce00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.370004:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.370014:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.370036:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.370043:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3ad77d/0xea31253a47cbaf3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.370068:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.370070:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.370072:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.372605:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.372619:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.372639:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.372644:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.372651:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.372666:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.372678:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.372685:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.372724:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.374226:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.374243:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.374280:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bd400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.374286:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.374298:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.374325:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.374334:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000001ced6d/0xea31253a47cbaf41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.374355:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.374357:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.374359:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.374597:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.374609:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.374626:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.374630:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.374635:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.374649:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.374658:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.374666:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.374686:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.375126:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.375136:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.375158:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bdc00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.375162:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.375179:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.375207:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.375214:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c70bb40a/0xea31253a47cbaf48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.375232:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.375234:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.375236:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.377904:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.377917:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.377934:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.377959:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.377966:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.377981:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.377992:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.378010:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.378034:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.378373:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.378429:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.378442:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bc200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.378447:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.378458:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.378513:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.378522:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078efa29a/0xea31253a47cbaf4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.378572:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.378574:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.378577:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.380300:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.380313:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.380330:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.380335:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.380341:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.380357:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.380368:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.380402:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.380428:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969500.380510:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969500.380525:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.380539:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bd600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969500.380545:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.380556:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.380579:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.380602:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ba8748/0xea31253a47cbaf56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.380636:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969500.380638:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969500.380642:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.381756:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.381767:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.381781:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.381786:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.382474:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.382500:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.382511:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.382518:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.382576:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969500.388342:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969500.388362:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.388458:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.388464:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.388473:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.388503:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.388515:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.388524:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391547:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969500.391562:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391577:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bc800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.391582:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391595:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391619:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391628:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000702a1244/0xea31253a47cbaf5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391654:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.391658:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391665:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.391677:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391686:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391696:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.391705:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.391706:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.391708:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969500.395858:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969500.395883:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e84b74/0xea31253a47cbaf64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.399735:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969500.401245:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783969500.401259:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.401278:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=562s v=(0 0) 00010000:00010000:1.0:1783969500.401284:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969500.401293:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.401309:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.401321:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.401348:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.401496:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969500.402049:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969500.402062:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.402079:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1783969500.402084:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969500.402090:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.402120:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402124:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969500.402142:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402143:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402159:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de7a00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.402163:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402172:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402190:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402197:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033b28474/0xea31253a47cbaf6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402216:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.402218:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.402220:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969500.402431:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969500.402453:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.402548:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.402556:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402587:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796a00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.402591:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402600:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402611:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402619:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca389ac/0xea31253a47cbaf72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.402634:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.402635:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.402638:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.403752:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.404463:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.404488:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.404526:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.404532:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.404541:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.404558:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.404570:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.404578:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.404614:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969500.406253:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969500.406267:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.406281:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bca00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.406286:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.406298:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.406340:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.406348:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe4cfd12/0xea31253a47cbaf79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.406377:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.406403:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.406406:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969500.407130:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969500.407140:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.407154:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1783969500.407159:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969500.407166:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.407180:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.407203:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.407212:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969500.407238:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1783969500.407313:0:18622:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1783969500.407434:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17137:x1870627099318400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 108340us (110133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969500.407445:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969500.407539:0:17137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17137:1870627099318400:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783969500.407556:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1783969500.407559:0:17137:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00010000:00010000:1.0:1783969500.407563:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.407582:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bda00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969500.407588:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.407597:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969500.407610:0:17137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17137:1870627099318528:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783969500.407613:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969500.407623:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000154a6078/0xea31253a47cbaf80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969500.407655:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969500.407664:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.407667:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969500.407670:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969500.407683:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab90da900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969500.408152:0:18923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099318528 00000100:00100000:2.0:1783969500.408160:0:18923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099318528 00000100:00100000:2.0:1783969500.408209:0:18923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969500.408219:0:18923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17137:x1870627099318528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783969500.408256:0:18923:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1783969500.430708:0:18616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1783969500.430749:0:18616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783969500.430754:0:18616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1783969500.431315:0:18923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17137:x1870627099318528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23093us (23656us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783969500.431327:0:18923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969500.435157:0:17137:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783969500.435175:0:17137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17137:1870627099318528:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783969500.435193:0:17137:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1783969501.427974:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969501.553252:0:17856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1870627099318784:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783969501.553339:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969501.553408:0:17856:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746540 going to sleep for 11 seconds 00000100:00100000:1.0:1783969501.553491:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099318784 00000100:00100000:1.0:1783969501.553502:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099318784 00000100:00100000:1.0:1783969501.553571:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783969501.553582:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17856:x1870627099318784:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1783969501.553635:0:18621:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1783969501.553916:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099318656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783969501.553954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969501.554207:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099318656 00000100:00100000:1.0:1783969501.554212:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099318656 00000100:00100000:1.0:1783969501.554245:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969501.554251:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870627099318656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969501.554264:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783969501.554316:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870627099318656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969501.554323:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969501.554439:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099318656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969501.572991:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17856:x1870627099318784:12345-0@lo:5:osp-pre-0-1.0 Request processed in 19403us (19644us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783969501.573005:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969501.573295:0:17856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1870627099318784:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783969501.573324:0:17856:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1783969501.573402:0:17856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17856:1870627099318912:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783969501.573439:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969501.573471:0:17856:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746540 going to sleep for 11 seconds 00000100:00100000:0.0:1783969501.573576:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099318912 00000100:00100000:0.0:1783969501.573583:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099318912 00000100:00100000:0.0:1783969501.573633:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969501.573641:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17856:x1870627099318912:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1783969501.573695:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17856:x1870627099318912:12345-0@lo:900:osp-pre-0-1.0 Request processed in 55us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969501.573702:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783969501.573772:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93e983efd880 x1870627099318912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783969517 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969501.573783:0:17856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17856:1870627099318912:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1783969502.448487:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969502.576862:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969502.576887:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099319040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969502.576958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969502.577003:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099319040 00000100:00100000:0.0:1783969502.577017:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099319040 00000100:00100000:0.0:1783969502.577064:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783969502.577074:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099319040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969502.577108:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783969502.577153:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099319040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969502.577161:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783969502.577206:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099319040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969503.090621:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969503.090647:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099319168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783969503.090708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969503.090753:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099319168 00000100:00100000:3.0:1783969503.090759:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099319168 00000100:00100000:3.0:1783969503.090799:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969503.090805:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099319168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969503.090832:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783969503.090864:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099319168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969503.090868:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969503.090900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099319168:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783969503.472489:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969504.497140:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783969504.881989:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783969505.520703:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783969505.648659:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969505.648666:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783969505.648670:0:38:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969505.648678:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 562 00000100:00080000:3.0:1783969505.648682:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783969505.648688:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93eab9286000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1783969505.648712:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabbff0e00 x1870627099319680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969505.648750:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969505.648753:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783969505.648755:0:38:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969505.648759:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:3.0:1783969505.648762:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783969505.648765:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93ea8325a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969505.648772:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099319680:0@lo:8:kworker.0 00000100:00100000:3.0:1783969505.648775:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabbff3b80 x1870627099320192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969505.648840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969505.648903:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099320192:0@lo:8:kworker.0 00000100:00100000:3.0:1783969505.648924:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099319296:0@lo:400:kworker.0 00000100:00100000:2.0:1783969505.648926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969505.648954:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969505.648989:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099319936:0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969505.649032:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099320576:0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969505.649057:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099319680 00000100:00100000:1.0:1783969505.649064:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099319680 00000100:00100000:3.0:1783969505.649072:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783969505.649077:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099319808:0@lo:400:kworker.0 00000100:00100000:1.0:1783969505.649091:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099320192 00000100:00100000:3.0:1783969505.649096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969505.649100:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099320192 00000100:00100000:3.0:1783969505.649111:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099320448:0@lo:400:kworker.0 00000100:00100000:1.0:1783969505.649120:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969505.649128:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099319680:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783969505.649130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1783969505.649148:0:18620:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783969505.649154:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099319424:0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649175:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969505.649190:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099320064:0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969505.649219:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783969505.649223:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099319552:0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969505.649253:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099320320:0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649269:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969505.649295:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099319936 00000100:00100000:3.0:1783969505.649298:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099319936 00000100:00100000:3.0:1783969505.649326:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099319424 00000100:00100000:3.0:1783969505.649329:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099319424 00000100:00100000:3.0:1783969505.649352:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969505.649359:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099319936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649447:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099319936:12345-0@lo:400:kworker.0 Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969505.649454:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969505.649469:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783969505.649475:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099319424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649506:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099319424:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969505.649512:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783969505.649528:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099320576 00000100:00100000:3.0:1783969505.649532:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099320576 00000100:00100000:3.0:1783969505.649559:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099319808 00000100:00100000:3.0:1783969505.649563:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099319808 00000100:00100000:3.0:1783969505.649572:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099320448 00000100:00100000:3.0:1783969505.649574:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099320448 00000100:00100000:3.0:1783969505.649586:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099320320 00000100:00100000:3.0:1783969505.649588:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099320320 00000100:00100000:3.0:1783969505.649599:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783969505.649605:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099320576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649635:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099320576:12345-0@lo:400:kworker.0 Request processed in 30us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969505.649641:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783969505.649652:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969505.649658:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099319808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649683:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099319808:12345-0@lo:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969505.649699:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969505.649711:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969505.649717:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099320448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649759:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099320448:12345-0@lo:400:kworker.0 Request processed in 42us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969505.649765:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969505.649777:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969505.649783:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099320320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649809:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099320320:12345-0@lo:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969505.649814:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1783969505.649838:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969505.649842:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783969505.649865:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff2d80 x1870627099320320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969505.649879:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099320320:0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649890:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099319424:0@lo:400:kworker.0 00010000:00080000:3.0:1783969505.649922:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff1180 x1870627099319808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969505.649931:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099319808:0@lo:400:kworker.0 00010000:00080000:3.0:1783969505.649941:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff0000 x1870627099320448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969505.649949:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099320448:0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.649968:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099319936:0@lo:400:kworker.0 00010000:00080000:3.0:1783969505.649978:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93eabbff0a80 x1870627099320576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969505.649986:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099320576:0@lo:400:kworker.0 00000100:00100000:2.0:1783969505.652778:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099319296 00000100:00100000:2.0:1783969505.652794:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099319296 00000100:00100000:2.0:1783969505.652847:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783969505.652858:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+21:3647:x1870627099319296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969505.652948:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+21:3647:x1870627099319296:12345-0@lo:400:kworker.0 Request processed in 91us (3991us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969505.652955:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783969505.652995:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099320064 00000100:00100000:2.0:1783969505.652998:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099320064 00000100:00100000:2.0:1783969505.653028:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099319552 00000100:00100000:2.0:1783969505.653031:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099319552 00000100:00100000:2.0:1783969505.653043:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969505.653048:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1870627099320064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969505.653088:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1870627099320064:12345-0@lo:400:kworker.0 Request processed in 39us (3879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969505.653094:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969505.653115:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969505.653121:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099319552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969505.653152:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099319552:12345-0@lo:400:kworker.0 Request processed in 31us (3907us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969505.653157:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969505.653169:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969505.653172:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1870627099320192:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783969505.653192:0:18622:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783969505.653238:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1870627099320192:12345-0@lo:8:kworker.0 Request processed in 63us (4310us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783969505.653244:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783969505.653749:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969505.653799:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969505.653805:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783969505.653809:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099320192:0@lo:8:kworker.0 00000100:00100000:2.0:1783969505.653844:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099319552:0@lo:400:kworker.0 00000100:00100000:2.0:1783969505.653855:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099320064:0@lo:400:kworker.0 00000100:00100000:2.0:1783969505.653886:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099319296:0@lo:400:kworker.0 00000100:00100000:3.0:1783969505.655300:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969505.655318:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099320704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969505.655372:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969505.658562:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099320704 00000100:00100000:0.0:1783969505.658577:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099320704 00000100:00100000:0.0:1783969505.658643:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969505.658654:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099320704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969505.658829:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783969505.658989:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099320704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 336us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969505.658997:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969505.659074:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099320704:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1783969505.661065:0:18616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000100:00100000:2.0:1783969505.694708:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099319680:12345-0@lo:8:kworker.0 Request processed in 45571us (45859us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783969505.694722:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1783969505.695509:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969505.695518:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783969505.695522:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099319680:0@lo:8:kworker.0 00010000:00010000:1.0:1783969506.549725:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969506.672826:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099320832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783969506.672904:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969506.673014:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099320832 00000100:00100000:2.0:1783969506.673022:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099320832 00000100:00100000:2.0:1783969506.673074:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969506.673085:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099320832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969506.673114:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783969506.673161:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099320832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969506.673168:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969506.673205:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1783969506.673225:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099320832:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1783969507.365112:0:19434:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783969507.365116:0:19434:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783969507.365117:0:19434:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783969507.365227:0:19434:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff93eab9fc1800 00000020:01000004:2.0:1783969507.365242:0:19434:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783969507.365257:0:19434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783969507.365270:0:19434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93e982190000) 00000020:00000080:2.0:1783969507.365286:0:19434:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783969507.438220:0:19434:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783969507.441100:0:19434:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1783969507.441315:0:19434:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783969507.441537:0:19434:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783969507.441921:0:19434:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783969507.442122:0:19434:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783969507.442352:0:19434:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1783969507.443736:0:19434:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783969507.443913:0:19434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1783969507.443926:0:19434:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783969507.443938:0:19434:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xea31253a47cbaf8e 00000020:01000004:0.0:1783969507.443945:0:19434:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1783969507.443969:0:19434:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783969507.443972:0:19434:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783969507.443977:0:19434:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1783969507.444000:0:19434:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1783969507.444005:0:19434:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1783969507.459988:0:19434:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783969507.460050:0:19434:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1783969507.460055:0:19434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783969507.460057:0:19434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783969507.460059:0:19434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969507.460060:0:19434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969507.460061:0:19434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969507.460062:0:19434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969507.460064:0:19434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969507.460066:0:19434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969507.460067:0:19434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969507.460071:0:19434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1783969507.460073:0:19434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783969507.460074:0:19434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783969507.460075:0:19434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969507.460076:0:19434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969507.460077:0:19434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969507.460079:0:19434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969507.460080:0:19434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969507.460090:0:19434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969507.460091:0:19434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969507.460129:0:19434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783969507.460151:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099320960:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783969507.460221:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.460288:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746540 going to sleep for 11 seconds 00000100:00100000:3.0:1783969507.460590:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099320960 00000100:00100000:3.0:1783969507.460599:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099320960 00000100:00100000:3.0:1783969507.460650:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783969507.460659:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:19434:x1870627099320960:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783969507.460693:0:17106:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783969507.460697:0:17106:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1783969507.460702:0:17106:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783969507.461226:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:19434:x1870627099320960:12345-0@lo:253:mount.lustre.0 Request processed in 565us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.461235:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783969507.463548:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099320960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783969507.463569:0:19434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783969507.463571:0:19434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783969507.463573:0:19434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783969507.463574:0:19434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969507.463575:0:19434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969507.463577:0:19434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969507.463578:0:19434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969507.463580:0:19434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969507.463581:0:19434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969507.463583:0:19434:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783969507.463608:0:19434:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93eab9fc1800 from lustre-OST0001 10000000:01000000:0.0:1783969507.463660:0:19434:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783969507.463664:0:19434:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783969507.463672:0:19434:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93eab71619c0 local copy 00010000:00010000:0.0:1783969507.463682:0:19434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969507.463787:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969507.463845:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969507.464159:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84b6b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969507.467417:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099321088 00000100:00100000:2.0:1783969507.467431:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099321088 00000100:00100000:3.0:1783969507.467580:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783969507.467591:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+21:19434:x1870627099321088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969507.467747:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+21:19434:x1870627099321088:12345-0@lo:501:mount.lustre.0 Request processed in 157us (3901us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783969507.467771:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783969507.468158:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321088:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783969507.468182:0:19434:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783969507.468207:0:19434:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783969507.468216:0:19434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.468234:0:19434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea83daf200/0xea31253a47cbabdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbabe4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969507.468264:0:19434:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93eab9fc1800 10000000:01000000:0.0:1783969507.468268:0:19434:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783969507.468274:0:19434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783969507.468277:0:19434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783969507.468282:0:19434:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783969507.468285:0:19434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783969507.468317:0:19434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796c00/0xea31253a47cbaf95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.468326:0:19434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93eab7796c00/0xea31253a47cbaf95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.468335:0:19434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93eab7796c00/0xea31253a47cbaf95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969507.468356:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783969507.468431:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969507.468480:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84b6b900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969507.468668:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099321216 00000100:00100000:3.0:1783969507.468673:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099321216 00000100:00100000:3.0:1783969507.468711:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783969507.468719:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:19434:x1870627099321216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969507.468729:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969507.468743:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea91a52c00/0xea31253a47cbaf9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbaf95 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.468765:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea91a52c00/0xea31253a47cbaf9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbaf95 expref: 22 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.468776:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea91a52c00/0xea31253a47cbaf9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbaf95 expref: 22 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.468785:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52c00, rc 0) 00000100:00100000:3.0:1783969507.468825:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321216:12345-0@lo:101:mount.lustre.0 Request processed in 107us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.468832:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783969507.468903:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969507.468916:0:19434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93eab7796c00/0xea31253a47cbaf95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaf9c expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969507.468925:0:19434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93eab7796c00/0xea31253a47cbaf95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbaf9c expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969507.472361:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783969507.473950:0:19434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969507.489333:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783969507.489467:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783969507.489484:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783969507.489497:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783969507.489509:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783969507.489521:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783969507.489545:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783969507.489550:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783969507.489674:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969507.489749:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.489788:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eabc1f33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969507.491476:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099321344 00000100:00100000:2.0:1783969507.491488:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099321344 00000100:00100000:2.0:1783969507.491546:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783969507.491555:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969507.491729:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321344:12345-0@lo:501:mount.lustre.0 Request processed in 174us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.491737:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783969507.491858:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969507.491905:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969507.491953:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969507.491992:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84b6b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969507.492222:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099321472 00000100:00100000:1.0:1783969507.492227:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099321472 00000100:00100000:1.0:1783969507.492260:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783969507.492268:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969507.493337:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321472:12345-0@lo:503:mount.lustre.0 Request processed in 1065us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969507.493348:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783969507.493498:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321472:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783969507.494148:0:19434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783969507.494239:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969507.494290:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969507.494328:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84b6b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969507.494433:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099321600 00000100:00100000:3.0:1783969507.494439:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099321600 00000100:00100000:3.0:1783969507.494686:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783969507.494695:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969507.497602:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321600:12345-0@lo:502:mount.lustre.0 Request processed in 2898us (3302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.497617:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783969507.498853:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783969507.499110:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783969507.499142:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783969507.499155:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783969507.499168:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783969507.499187:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783969507.499199:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783969507.499213:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783969507.499228:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783969507.499239:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1783969507.499276:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969507.499335:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.499404:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e982746000 going to sleep for 11 seconds 00000100:00100000:3.0:1783969507.500063:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099321728 00000100:00100000:3.0:1783969507.500073:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099321728 00000100:00100000:3.0:1783969507.500129:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783969507.500139:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969507.500273:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321728:12345-0@lo:502:mount.lustre.0 Request processed in 134us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.500281:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783969507.502048:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783969507.502142:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1783969507.502157:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1783969507.503151:0:19438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783969507.503161:0:19438:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783969507.503167:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969507.503170:0:19438:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783969507.503176:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783969507.503208:0:19438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93e982793380) 00000020:00000080:1.0:1783969507.503238:0:19438:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783969507.503246:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783969507.503323:0:19438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93eab9fc1800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783969507.503333:0:19438:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783969507.503339:0:19438:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xea31253a47cbafaa 00010000:00010000:1.0:1783969507.514504:0:19438:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1783969507.516069:0:19438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1783969507.525800:0:19438:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1783969507.528441:0:19438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783969507.528621:0:19438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969507.528629:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969507.528631:0:19438:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783969507.528635:0:19438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969507.528639:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969507.528640:0:19438:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783969507.528644:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783969507.528646:0:19438:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783969507.528648:0:19438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969507.528650:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969507.528651:0:19438:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783969507.528654:0:19438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969507.528656:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969507.528658:0:19438:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783969507.528661:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783969507.528691:0:19438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969507.528694:0:19438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969507.528695:0:19438:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783969507.528699:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1783969507.529129:0:19434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1783969507.529160:0:19434:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783969507.529186:0:19434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93eab7796c00/0xea31253a47cbaf95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaf9c expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969507.529199:0:19434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93eab7796c00/0xea31253a47cbaf95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbaf9c expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969507.529208:0:19434:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab9fc1800 from 1 10000000:01000000:2.0:1783969507.529211:0:19434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969507.529252:0:19434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969507.529261:0:19434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969507.529273:0:19434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969507.529314:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969507.529425:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.529472:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86ffcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969507.531598:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099321856 00000100:00100000:3.0:1783969507.531611:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099321856 00000100:00100000:3.0:1783969507.531671:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783969507.531684:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:19434:x1870627099321856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969507.531704:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969507.531723:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbafb1 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.531750:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbafb1 expref: 23 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.531762:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbafb1 expref: 23 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.531778:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52000, rc 0) 00000100:00100000:3.0:1783969507.531848:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099321856:12345-0@lo:101:mount.lustre.0 Request processed in 167us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.531856:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783969507.534424:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969507.534467:0:19434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969507.534481:0:19434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969507.537706:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783969507.538080:0:19434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969507.538286:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783969507.538314:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783969507.538333:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783969507.538339:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783969507.538481:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969507.538554:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.538594:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea997d23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969507.538875:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099321984 00000100:00100000:1.0:1783969507.538881:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099321984 00000100:00100000:1.0:1783969507.538930:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783969507.538940:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099321984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969507.539053:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099321984:12345-0@lo:501:mount.lustre.0 Request processed in 115us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969507.539060:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783969507.542010:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099321984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969507.542073:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969507.542143:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.542223:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea997d23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969507.553466:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099322112 00000100:00100000:3.0:1783969507.553480:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099322112 00000100:00100000:2.0:1783969507.553620:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783969507.553630:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099322112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969507.553821:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099322112:12345-0@lo:503:mount.lustre.0 Request processed in 192us (11677us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.553829:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783969507.556022:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783969507.556541:0:19434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969507.556645:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969507.556715:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.556760:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea901f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969507.556934:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099322240 00000100:00100000:2.0:1783969507.556940:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099322240 00000100:00100000:2.0:1783969507.556990:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783969507.557000:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099322240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969507.557117:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099322240:12345-0@lo:502:mount.lustre.0 Request processed in 118us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.557125:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783969507.557159:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969507.557407:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783969507.557445:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783969507.557465:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783969507.557479:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783969507.557492:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783969507.557505:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783969507.557519:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783969507.557531:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1783969507.557545:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783969507.557559:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1783969507.557573:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1783969507.557601:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969507.557644:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969507.557680:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84b6b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969507.558210:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099322368 00000100:00100000:2.0:1783969507.558216:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099322368 00000100:00100000:2.0:1783969507.558263:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783969507.558272:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099322368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969507.558431:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099322368:12345-0@lo:502:mount.lustre.0 Request processed in 159us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.558439:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783969507.559893:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969507.560002:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1783969507.560014:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00010000:00010000:3.0:1783969507.568729:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783969507.570066:0:19442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969507.570080:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969507.570082:0:19442:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783969507.570089:0:19442:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93eab9fc1800 00000020:00000080:0.0:1783969507.570095:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969507.570103:0:19442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969507.570119:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969507.570120:0:19442:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783969507.570123:0:19442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969507.570126:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969507.570127:0:19442:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783969507.570130:0:19442:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff93eab9fc1800 00000020:00000080:0.0:1783969507.570132:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969507.570187:0:19442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969507.570191:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969507.570192:0:19442:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783969507.570194:0:19442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969507.570197:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969507.570198:0:19442:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783969507.570201:0:19442:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93eab9fc1800 00000020:00000080:0.0:1783969507.570203:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969507.570220:0:19442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969507.570223:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969507.570224:0:19442:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783969507.570226:0:19442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969507.570228:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969507.570230:0:19442:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783969507.570233:0:19442:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93eab9fc1800 00000020:00000080:0.0:1783969507.570235:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969507.570257:0:19442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969507.570259:0:19442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969507.570260:0:19442:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783969507.570263:0:19442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1783969507.570610:0:19434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783969507.570644:0:19434:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969507.570665:0:19434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.570676:0:19434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969507.570736:0:19434:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783969507.570739:0:19434:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93eab9fc1800 10000000:01000000:3.0:1783969507.570742:0:19434:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93eab9fc1800 10000000:01000000:3.0:1783969507.570746:0:19434:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969507.570751:0:19434:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff93eab9fc1800 from 1 10000000:01000000:3.0:1783969507.570753:0:19434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969507.570788:0:19434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a53800/0xea31253a47cbafbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.570804:0:19434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a53800/0xea31253a47cbafbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.570815:0:19434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a53800/0xea31253a47cbafbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969507.570853:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783969507.570924:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.570968:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074540 going to sleep for 11 seconds 00000100:00100000:0.0:1783969507.572965:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099322496 00000100:00100000:0.0:1783969507.572978:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099322496 00000100:00100000:0.0:1783969507.573029:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783969507.573039:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+23:19434:x1870627099322496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969507.573055:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969507.573078:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797800/0xea31253a47cbafc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbafbf expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.573105:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797800/0xea31253a47cbafc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbafbf expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.573116:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797800/0xea31253a47cbafc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbafbf expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.573125:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797800, rc 0) 00000100:00100000:0.0:1783969507.573959:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099322496:12345-0@lo:101:mount.lustre.0 Request processed in 917us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969507.573968:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783969507.591475:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969507.591508:0:19434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a53800/0xea31253a47cbafbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbafc6 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969507.591534:0:19434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a53800/0xea31253a47cbafbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbafc6 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969507.597614:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1783969507.598040:0:19434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969507.598294:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783969507.598320:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783969507.598334:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783969507.598348:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783969507.598419:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783969507.598435:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783969507.600961:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783969507.601023:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783969507.601041:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783969507.601056:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783969507.601070:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783969507.601083:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783969507.601098:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783969507.601111:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783969507.601125:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783969507.601139:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783969507.601162:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783969507.601177:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783969507.601190:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783969507.601216:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783969507.601249:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783969507.601265:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783969507.601278:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783969507.601293:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783969507.601307:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1783969507.601321:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1783969507.601334:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1783969507.601346:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1783969507.601359:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1783969507.601414:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1783969507.601429:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1783969507.604450:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1783969507.604504:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1783969507.604520:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1783969507.604533:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1783969507.604546:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1783969507.604579:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1783969507.604595:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1783969507.604607:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1783969507.604620:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1783969507.604632:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1783969507.604644:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1783969507.604656:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1783969507.604669:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1783969507.604681:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1783969507.604694:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1783969507.604722:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1783969507.604728:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1783969507.604860:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969507.604930:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.604990:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8562dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969507.608689:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099322624 00000100:00100000:1.0:1783969507.608705:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099322624 00000100:00100000:1.0:1783969507.608780:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783969507.608791:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099322624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969507.608979:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099322624:12345-0@lo:501:mount.lustre.0 Request processed in 189us (4048us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969507.608987:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783969507.609125:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969507.609179:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969507.609234:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.609273:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8562dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969507.609444:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099322752 00000100:00100000:1.0:1783969507.609457:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099322752 00000100:00100000:1.0:1783969507.609487:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783969507.609494:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099322752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969507.609579:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099322752:12345-0@lo:503:mount.lustre.0 Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969507.609586:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783969507.610098:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322752:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783969507.614785:0:19434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969507.614890:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322880:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969507.614974:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.618662:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8562dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969507.625702:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099322880 00000100:00100000:1.0:1783969507.625720:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099322880 00000100:00100000:1.0:1783969507.625801:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783969507.625812:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099322880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969507.625994:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099322880:12345-0@lo:502:mount.lustre.0 Request processed in 182us (11019us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969507.626003:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783969507.626148:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099322880:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783969507.626437:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783969507.626484:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783969507.626502:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783969507.626534:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783969507.626550:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783969507.626565:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783969507.626579:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783969507.626593:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783969507.626607:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783969507.626620:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783969507.626634:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783969507.626648:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783969507.626661:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783969507.626675:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783969507.626689:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783969507.626703:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783969507.626716:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783969507.626727:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783969507.626751:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783969507.626777:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783969507.626791:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783969507.626804:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783969507.626817:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783969507.626831:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783969507.626842:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1783969507.626856:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1783969507.626868:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1783969507.626881:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1783969507.626895:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1783969507.626907:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1783969507.626920:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1783969507.626934:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1783969507.626946:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1783969507.626958:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1783969507.626972:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1783969507.626998:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1783969507.627013:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1783969507.627025:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1783969507.627037:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1783969507.627050:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1783969507.627063:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1783969507.627076:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1783969507.627088:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1783969507.627101:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1783969507.627115:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1783969507.627128:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1783969507.627140:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1783969507.627153:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1783969507.627201:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099323008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969507.627258:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.627298:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8562dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969507.628581:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099323008 00000100:00100000:1.0:1783969507.628599:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099323008 00000100:00100000:1.0:1783969507.628654:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783969507.628663:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099323008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969507.628801:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099323008:12345-0@lo:502:mount.lustre.0 Request processed in 138us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969507.628811:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783969507.629194:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099323008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783969507.629425:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1783969507.630433:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1783969507.630688:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099323136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969507.630755:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.631912:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8562dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969507.641839:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099323136 00000100:00100000:1.0:1783969507.641854:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099323136 00000100:00100000:1.0:1783969507.641918:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783969507.641929:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099323136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969507.643718:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099323136:12345-0@lo:502:mount.lustre.0 Request processed in 1784us (12955us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969507.643733:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783969507.644531:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099323136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783969507.644636:0:19434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1783969507.644651:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783969507.645885:0:19448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783969507.645902:0:19448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93e9827919c0) 00000020:00000080:1.0:1783969507.645930:0:19448:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1783969507.646096:0:19448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93eab9fc1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783969507.646100:0:19448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93eab9fc1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783969507.646103:0:19448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eab9fc1800 3 00010000:00080000:1.0:1783969507.646135:0:19448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93e983e4c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1783969507.658578:0:19448:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1783969507.658693:0:19448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783969507.658740:0:19448:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783969507.658757:0:19448:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xea31253a47cbafd4 00000100:00080000:1.0:1783969507.658768:0:19448:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783969507.658774:0:19448:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93e983e4c000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969507.658826:0:19448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf852680 x1870627099323264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783969507.658869:0:19448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783969507.659203:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099323264:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969507.659278:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783969507.659504:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969507.659509:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783969507.659511:0:38:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783969507.659524:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 567 00000100:00080000:2.0:1783969507.659527:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783969507.659531:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93eab9286000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969507.659547:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ea867b1880 x1870627099323648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969507.659588:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783969507.659592:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783969507.659594:0:38:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783969507.659598:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 567 00000100:00080000:2.0:1783969507.659601:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783969507.659605:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93ea8325a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1783969507.659615:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93e98319d880 x1870627099324160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969507.659654:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099323520:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.659687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.659707:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099324288:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.659727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.659744:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783969507.659750:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099323392:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.659775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.659792:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099324032:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.659812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.659836:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099323904:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.659857:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.659880:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099324544:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.659900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.659915:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783969507.659920:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099323776:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.659940:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.659955:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099324416:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.659973:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.659995:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099323520 00000100:00100000:2.0:1783969507.660002:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099323520 00000100:00100000:2.0:1783969507.660045:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099324032 00000100:00100000:2.0:1783969507.660049:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099324032 00000100:00100000:2.0:1783969507.660071:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969507.660080:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099323520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.660129:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099323520:12345-0@lo:400:kworker.0 Request processed in 48us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.660137:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969507.660155:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969507.660161:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099324032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.660193:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099324032:12345-0@lo:400:kworker.0 Request processed in 24us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.660199:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969507.660217:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099323264 00000100:00100000:2.0:1783969507.660220:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099323264 00000100:00100000:2.0:1783969507.660232:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099324288 00000100:00100000:2.0:1783969507.660234:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099324288 00000100:00100000:2.0:1783969507.660248:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099324544 00000100:00100000:2.0:1783969507.660250:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099324544 00000100:00100000:2.0:1783969507.660263:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099323776 00000100:00100000:2.0:1783969507.660271:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099323776 00000100:00100000:2.0:1783969507.660284:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099324416 00000100:00100000:2.0:1783969507.660286:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099324416 00000100:00100000:2.0:1783969507.660298:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783969507.660304:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099324288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.660335:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099324288:12345-0@lo:400:kworker.0 Request processed in 30us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.660341:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783969507.660352:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783969507.660358:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099324544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.660429:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099324544:12345-0@lo:400:kworker.0 Request processed in 71us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.660436:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783969507.660448:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783969507.660454:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099323776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.660479:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099323776:12345-0@lo:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.660484:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783969507.660494:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783969507.660500:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099324416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.660524:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099324416:12345-0@lo:400:kworker.0 Request processed in 24us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.660530:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783969507.660540:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969507.660545:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099323264:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783969507.660564:0:17112:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:2.0:1783969507.660611:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xea31253a47cbafdb 00000004:00100000:2.0:1783969507.660627:0:17112:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783969507.660658:0:17112:0:(import.c:65:import_set_state_nolock()) ffff93e981aba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969507.660691:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870627099323264:12345-0@lo:38:llog_process_th.0 Request processed in 145us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.660698:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1783969507.660716:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969507.660720:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969507.660723:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969507.660738:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea867b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099323648:0@lo:8:kworker.0 00000100:00100000:2.0:1783969507.660762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.660779:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099324160:0@lo:8:kworker.0 00000100:00100000:2.0:1783969507.660798:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783969507.660825:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf852680 x1870627099323264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969507.660836:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969507.660843:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783969507.660851:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783969507.660855:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783969507.660858:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e983e4c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783969507.660863:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1870627099323264:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783969507.660889:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099323648 00000100:00100000:2.0:1783969507.660892:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099323648 00000100:00100000:2.0:1783969507.660904:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099324160 00000100:00100000:2.0:1783969507.660906:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099324160 00000100:00100000:2.0:1783969507.660915:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969507.660919:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099323648:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783969507.660965:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099323648:12345-0@lo:8:kworker.0 Request processed in 43us (201us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783969507.660972:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969507.660983:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783969507.660987:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099324160:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783969507.661016:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1870627099324160:12345-0@lo:8:kworker.0 Request processed in 27us (216us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783969507.661022:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783969507.661046:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea867b3b80 x1870627099323776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969507.661057:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099323776:0@lo:400:kworker.0 00010000:00080000:2.0:1783969507.661067:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319c700 x1870627099324416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969507.661075:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099324416:0@lo:400:kworker.0 00010000:00080000:2.0:1783969507.661085:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319ea00 x1870627099324544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969507.661094:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099324544:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.661124:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099324032:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.661135:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099323520:0@lo:400:kworker.0 00010000:00080000:2.0:1783969507.661145:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e98319e680 x1870627099324288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969507.661154:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099324288:0@lo:400:kworker.0 00000100:00100000:2.0:1783969507.661178:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969507.661188:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969507.661192:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783969507.661195:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099323648:0@lo:8:kworker.0 00000100:00100000:2.0:1783969507.661204:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969507.661207:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969507.661210:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783969507.661212:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98319d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099324160:0@lo:8:kworker.0 00000100:00100000:3.0:1783969507.665205:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099323392 00000100:00100000:3.0:1783969507.665221:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099323392 00000100:00100000:3.0:1783969507.665283:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099323904 00000100:00100000:3.0:1783969507.665286:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099323904 00000100:00100000:3.0:1783969507.665305:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783969507.665313:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099323392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969507.665441:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099323392:12345-0@lo:400:kworker.0 Request processed in 128us (5664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.665523:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783969507.665543:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783969507.665550:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099323904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969507.665591:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099323904:12345-0@lo:400:kworker.0 Request processed in 41us (5732us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.665598:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783969507.665651:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea867b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099323904:0@lo:400:kworker.0 00000100:00100000:3.0:1783969507.665683:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099323392:0@lo:400:kworker.0 00000020:01000004:0.0:1783969507.668919:0:19448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783969507.668937:0:19448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93eaa5b019c0) 00000020:00000080:0.0:1783969507.668963:0:19448:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783969507.669153:0:19448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93eab9fc1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783969507.669158:0:19448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93eab9fc1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783969507.669160:0:19448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93eab9fc1800 3 00010000:00080000:0.0:1783969507.669193:0:19448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93e983e4b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1783969507.674573:0:19448:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1783969507.674681:0:19448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783969507.674729:0:19448:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783969507.674744:0:19448:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xea31253a47cbafe9 00000100:00080000:0.0:1783969507.674755:0:19448:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969507.674761:0:19448:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93e983e4b800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1783969507.674795:0:19448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eab73e1880 x1870627099324672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969507.674858:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1870627099324672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783969507.674933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.675035:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099324672 00000100:00100000:2.0:1783969507.675043:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099324672 00000100:00100000:2.0:1783969507.675084:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969507.675094:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1870627099324672:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783969507.675122:0:17112:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 569 last 0 00000020:00000080:2.0:1783969507.675159:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xea31253a47cbaff0 00000004:00100000:2.0:1783969507.675174:0:17112:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783969507.675205:0:17112:0:(import.c:65:import_set_state_nolock()) ffff93e981abe000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783969507.681215:0:19448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783969507.681617:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870627099324672:12345-0@lo:38:llog_process_th.0 Request processed in 6517us (6678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.681630:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1783969507.682274:0:19448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1783969507.682500:0:19434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783969507.682532:0:19434:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783969507.682552:0:19434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a53800/0xea31253a47cbafbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbafc6 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969507.682564:0:19434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a53800/0xea31253a47cbafbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbafc6 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783969507.682619:0:19434:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783969507.682625:0:19434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783969507.682626:0:19434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969507.682627:0:19434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969507.682628:0:19434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969507.682629:0:19434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969507.682631:0:19434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969507.682633:0:19434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969507.682634:0:19434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783969507.682638:0:19434:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1783969507.682640:0:19434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783969507.682641:0:19434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783969507.682642:0:19434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969507.682643:0:19434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969507.682644:0:19434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969507.682645:0:19434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969507.682646:0:19434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969507.682646:0:19434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969507.682647:0:19434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783969507.682672:0:19434:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783969507.682694:0:19434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099324800:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783969507.682758:0:19434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969507.682791:0:19434:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8b0180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969507.682846:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099324800 00000100:00100000:2.0:1783969507.682853:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099324800 00000100:00100000:2.0:1783969507.682891:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969507.682899:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099324800:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783969507.682925:0:17107:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783969507.682940:0:17107:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1783969507.685185:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e1880 x1870627099324672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969507.685201:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783969507.685211:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1783969507.685220:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783969507.685226:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783969507.685230:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93e983e4b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783969507.685237:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1870627099324672:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1783969507.689215:0:17107:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783969507.689239:0:17107:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783969507.689583:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:19434:x1870627099324800:12345-0@lo:253:mount.lustre.0 Request processed in 6678us (6819us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969507.689596:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969507.689666:0:19434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:451c11fa-8d33-493c-b495-458f5de7342a:19434:1870627099324800:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783969507.689692:0:19434:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783969507.689696:0:19434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969507.689698:0:19434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783969507.689699:0:19434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969507.689700:0:19434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969507.689702:0:19434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969507.689703:0:19434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969507.689704:0:19434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969507.689706:0:19434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969507.689707:0:19434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783969507.689721:0:19434:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1783969507.690259:0:17128:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783969507.690265:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783969507.690283:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.690298:0:17128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbae99 expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.690307:0:17128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbaea7 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.690314:0:17128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.690348:0:17128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbaea7 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.690371:0:17128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbaea7 expref: 23 pid: 17107 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969507.690405:0:17128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099324928:0@lo:104: 00000100:00100000:0.0:1783969507.690451:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969507.690491:0:17128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbae99 expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.690499:0:17128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbae99 expref: 23 pid: 17105 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969507.690508:0:17128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099325056:0@lo:104: 00000100:00100000:0.0:1783969507.690526:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969507.690552:0:17128:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea84b6b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969507.690730:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099324928 00000100:00100000:3.0:1783969507.690737:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099324928 00000100:00100000:3.0:1783969507.690764:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099325056 00000100:00100000:3.0:1783969507.690770:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099325056 00000100:00100000:3.0:1783969507.690784:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969507.690790:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+4:17128:x1870627099324928:12345-0@lo:104: 00010000:00010000:3.0:1783969507.690802:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.690853:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783969507.690859:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+4:17128:x1870627099324928:12345-0@lo:104: Request processed in 69us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.690865:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969507.690877:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783969507.690882:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+3:17128:x1870627099325056:12345-0@lo:104: 00010000:00010000:3.0:1783969507.690889:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.690914:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783969507.690918:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:451c11fa-8d33-493c-b495-458f5de7342a+3:17128:x1870627099325056:12345-0@lo:104: Request processed in 36us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.690924:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1783969507.690936:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969507.690941:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.690948:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52400 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969507.690952:0:17100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.690961:0:17100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969507.690979:0:17100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969507.690984:0:17100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969507.691009:0:17100:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691015:0:17100:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969507.691031:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691038:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea91a52400/0xea31253a47cbaea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaeae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691049:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969507.691052:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691057:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53000 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969507.691060:0:17100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691067:0:17100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969507.691073:0:17100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969507.691078:0:17100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969507.691092:0:17100:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691098:0:17100:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969507.691102:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691109:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbae99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbaea0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691120:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969507.691121:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969507.691123:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969507.691128:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969507.691138:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099325184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969507.691164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.691180:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969507.691185:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099325312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969507.691199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969507.691223:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099325184 00000100:00100000:3.0:1783969507.691226:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099325184 00010000:00010000:3.0:1783969507.691241:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbaea7 expref: 24 pid: 17107 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969507.691256:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099325312 00000100:00100000:3.0:1783969507.691258:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099325312 00010000:00010000:3.0:1783969507.691265:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbae99 expref: 25 pid: 17105 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969507.691274:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969507.691279:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+25:3646:x1870627099325184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969507.691293:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969507.691298:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbaea7 expref: 25 pid: 17107 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691307:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbaea7 expref: 25 pid: 17107 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691320:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969507.691342:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+25:3646:x1870627099325184:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.691348:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969507.691374:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783969507.691400:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+24:3646:x1870627099325312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969507.691407:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969507.691411:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbae99 expref: 24 pid: 17105 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691419:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbae99 expref: 24 pid: 17105 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691430:0:17098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691438:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783969507.691459:0:17098:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002745866s 00010000:00010000:3.0:1783969507.691464:0:17098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691480:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691488:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691494:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691499:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969507.691503:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691510:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691518:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969507.691527:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969507.691548:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+24:3646:x1870627099325312:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969507.691554:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783969507.691581:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099325312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969507.691588:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099325184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969507.691740:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e983de6400/0xea31253a47cbaeae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbaea7 expref: 23 pid: 17107 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969507.691751:0:17128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099324928:0@lo:104: 00010000:00010000:0.0:1783969507.691759:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea83daea00/0xea31253a47cbaea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbae99 expref: 22 pid: 17105 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969507.691767:0:17128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17128:1870627099325056:0@lo:104: 00010000:00010000:0.0:1783969507.691786:0:17128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.691797:0:17128:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.691804:0:17128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969507.691810:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93eab7796800/0xea31253a47cbaff7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1783969507.692819:0:19434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783969507.699342:0:19434:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783969507.699353:0:19434:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783969507.699418:0:19434:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783969507.699567:0:19434:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783969507.699589:0:19434:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1783969507.699615:0:19434:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1783969507.702700:0:19434:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783969507.703023:0:19434:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783969507.708375:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099325440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969507.708477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969507.708585:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099325440 00000100:00100000:0.0:1783969507.708593:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099325440 00000100:00100000:0.0:1783969507.708644:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783969507.708655:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099325440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783969507.708695:0:17854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783969507.708742:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099325440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969507.708750:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783969507.708796:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099325440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969508.211147:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969508.211190:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099325568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969508.211269:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969508.211612:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099325568 00000100:00100000:3.0:1783969508.211621:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099325568 00000100:00100000:3.0:1783969508.211680:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783969508.211703:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099325568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969508.211738:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783969508.211793:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099325568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969508.211800:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783969508.211892:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099325568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783969508.593013:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783969508.721814:0:17109:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783969508.721822:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93e9835eb000 from 10 10000000:01000000:2.0:1783969508.721827:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783969508.721872:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea837bca00/0xea31253a47cbaffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969508.721883:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea837bca00/0xea31253a47cbaffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969508.721894:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea837bca00/0xea31253a47cbaffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969508.721922:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099325696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969508.721987:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969508.722069:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea85549840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969508.729920:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099325696 00000100:00100000:0.0:1783969508.729938:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099325696 00000100:00100000:0.0:1783969508.730012:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783969508.730024:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:17109:x1870627099325696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969508.730041:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969508.730064:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7796a00/0xea31253a47cbb005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbaffe expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969508.730093:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7796a00/0xea31253a47cbb005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbaffe expref: 23 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969508.730104:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7796a00/0xea31253a47cbb005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbaffe expref: 23 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969508.730114:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7796a00, rc 0) 00000100:00100000:0.0:1783969508.730859:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099325696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 834us (8867us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969508.730867:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783969508.732153:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099325696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969508.732182:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea837bca00/0xea31253a47cbaffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb005 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969508.732194:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea837bca00/0xea31253a47cbaffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbb005 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969508.732278:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099325824:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783969508.732339:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969508.732450:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969508.733670:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099325824 00000100:00100000:2.0:1783969508.733680:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099325824 00000100:00100000:2.0:1783969508.733732:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783969508.733742:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099325824:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783969508.733764:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783969508.733787:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783969508.733789:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1783969508.733889:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099325824:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969508.733897:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783969508.736437:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099325824:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783969508.736538:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969508.736549:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea837bca00/0xea31253a47cbaffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb005 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969508.736560:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea837bca00/0xea31253a47cbaffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb005 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969508.736570:0:17109:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783969508.736572:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff93e98330a000 from 10 10000000:01000000:3.0:1783969508.736575:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783969508.736611:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbb00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969508.736619:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbb00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969508.736628:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbb00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969508.736648:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099325952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969508.736702:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969508.736746:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969508.737532:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099325952 00000100:00100000:0.0:1783969508.737548:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099325952 00000100:00100000:0.0:1783969508.737597:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783969508.737607:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099325952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969508.737621:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969508.737635:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93eab7797000/0xea31253a47cbb013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbb00c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969508.737660:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93eab7797000/0xea31253a47cbb013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbb00c expref: 24 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969508.737671:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93eab7797000/0xea31253a47cbb013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbb00c expref: 24 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969508.737680:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93eab7797000, rc 0) 00000100:00100000:0.0:1783969508.737726:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:17109:x1870627099325952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969508.737732:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783969508.738419:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099325952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969508.738502:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbb00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb013 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969508.738513:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbb00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbb013 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969508.738574:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099326080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783969508.738612:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969508.740958:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eac0da43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969508.754584:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099326080 00000100:00100000:0.0:1783969508.754600:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099326080 00000100:00100000:0.0:1783969508.754688:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783969508.754702:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:17109:x1870627099326080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783969508.754734:0:17107:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783969508.754761:0:17107:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783969508.754764:0:17107:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1783969508.754893:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:17109:x1870627099326080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 196us (16279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969508.754901:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783969508.755065:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099326080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783969508.755176:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969508.755192:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbb00c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb013 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969508.755212:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a53000/0xea31253a47cbb00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb013 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1783969508.785170:0:19500:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783969508.786940:0:19500:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1783969508.979151:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783969509.629349:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969510.642143:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969510.780047:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099326208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969510.780132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969510.780281:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099326208 00000100:00100000:0.0:1783969510.780304:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099326208 00000100:00100000:0.0:1783969510.780433:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969510.780451:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099326208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969510.780484:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783969510.780532:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099326208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969510.780539:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783969510.780729:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969510.780773:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099326208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783969511.664626:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969511.793028:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969511.793055:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099326336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969511.793126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969511.793174:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099326336 00000100:00100000:0.0:1783969511.793181:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099326336 00000100:00100000:0.0:1783969511.793241:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969511.793255:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099326336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783969511.793280:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783969511.793341:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099326336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969511.793349:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969511.793422:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099326336:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783969511.793603:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783969512.688483:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783969512.819906:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969512.819913:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783969512.819916:0:36:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969512.819928:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93eab9286000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969512.819949:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf850380 x1870627099326848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783969512.819983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969512.819986:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783969512.819995:0:36:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969512.820001:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93ea8325a800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1783969512.820013:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93eabf851180 x1870627099327360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969512.820094:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099326464:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.820167:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969512.820209:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099327104:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.820237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969512.820257:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099327744:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.821915:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969512.822007:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783969512.822018:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099326592:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.822056:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969512.822077:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099327232:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.822100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969512.822120:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099327872:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.822143:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.824214:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099326848:0@lo:8:kworker.0 00000100:00100000:3.0:1783969512.824289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.824326:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099327360:0@lo:8:kworker.0 00000100:00100000:3.0:1783969512.824349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.824404:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099326976:0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.824438:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099326720:0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.824462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.824480:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099327488:0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.824521:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099327232 00000100:00100000:3.0:1783969512.829018:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099327232 00000100:00100000:3.0:1783969512.829084:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099326848 00000100:00100000:3.0:1783969512.829088:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099326848 00000100:00100000:3.0:1783969512.829098:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099327360 00000100:00100000:3.0:1783969512.829101:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099327360 00000100:00100000:3.0:1783969512.829109:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099326720 00000100:00100000:3.0:1783969512.829111:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099326720 00000100:00100000:3.0:1783969512.829160:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969512.829184:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099327232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.829292:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099327232:12345-0@lo:400:kworker.0 Request processed in 110us (7190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.829300:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969512.829318:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969512.829324:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099326720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.829359:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099326720:12345-0@lo:400:kworker.0 Request processed in 36us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.829366:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969512.829394:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969512.829400:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1870627099326848:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783969512.829428:0:18622:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:3.0:1783969512.829458:0:18622:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea31253a47cbb01a 00002000:00100000:3.0:1783969512.829484:0:18622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93e983f99800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783969512.829489:0:18622:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783969512.829493:0:18622:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783969512.829757:0:18622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783969512.829783:0:18622:0:(import.c:65:import_set_state_nolock()) ffff93e983f9d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969512.829827:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1870627099326848:12345-0@lo:8:kworker.0 Request processed in 425us (5547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.829834:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969512.829848:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969512.829852:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1870627099327360:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783969512.829867:0:18622:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:3.0:1783969512.829883:0:18622:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xea31253a47cbb021 00002000:00100000:3.0:1783969512.829896:0:18622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93e983f9c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1783969512.829900:0:18622:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1783969512.829902:0:18622:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783969512.829924:0:18622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1783969512.829937:0:18622:0:(import.c:65:import_set_state_nolock()) ffff93e983f9b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969512.829967:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1870627099327360:12345-0@lo:8:kworker.0 Request processed in 113us (5616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.829974:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783969512.830008:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783969512.830046:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf850380 x1870627099326848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783969512.830063:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783969512.830071:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783969512.830076:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783969512.830079:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93eab9286000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783969512.830103:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783969512.830108:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1870627099326848:0@lo:8:kworker.0 00010000:00080000:3.0:1783969512.830123:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf851180 x1870627099327360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783969512.830132:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783969512.830137:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783969512.830140:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783969512.830142:0:3645:0:(import.c:65:import_set_state_nolock()) ffff93ea8325a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783969512.830161:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783969512.830164:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1870627099327360:0@lo:8:kworker.0 00000004:00080000:3.0:1783969512.830193:0:17138:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783969512.830256:0:17138:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 574957874039ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783969512.830262:0:17138:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1783969512.830334:0:17858:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783969512.830355:0:17858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1870627099328256:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1783969512.830417:0:17858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.830436:0:17858:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983419300 going to sleep for 11 seconds 00000100:00100000:3.0:1783969512.830453:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099328256 00000100:00100000:3.0:1783969512.830456:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099328256 00000100:00100000:3.0:1783969512.830483:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969512.830490:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17858:x1870627099328256:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1783969512.830854:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1783969512.831738:0:17139:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1783969512.831760:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17139:1870627099328512:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783969512.831798:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969512.831815:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab7074480 going to sleep for 11 seconds 00000100:00100000:1.0:1783969512.831834:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099326464 00000100:00100000:1.0:1783969512.831838:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099326464 00000100:00100000:1.0:1783969512.831877:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783969512.831885:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:3648:x1870627099326464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.831933:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:3648:x1870627099326464:12345-0@lo:400:kworker.0 Request processed in 49us (11766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969512.831941:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783969512.831971:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099327104 00000100:00100000:1.0:1783969512.831975:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099327104 00000100:00100000:1.0:1783969512.831997:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099326592 00000100:00100000:1.0:1783969512.832000:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099326592 00000100:00100000:1.0:1783969512.832014:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783969512.832020:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099327104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.832054:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099327104:12345-0@lo:400:kworker.0 Request processed in 34us (11816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969512.832061:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783969512.832073:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783969512.832079:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099326592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.832106:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099326592:12345-0@lo:400:kworker.0 Request processed in 27us (10049us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969512.832112:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783969512.832131:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099328512 00000100:00100000:1.0:1783969512.832134:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099328512 00000100:00100000:1.0:1783969512.832163:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783969512.832169:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17139:x1870627099328512:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783969512.833698:0:18622:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783969512.833706:0:18622:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783969512.833781:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17858:x1870627099328256:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3289us (3363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.833790:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783969512.835414:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099327744 00000100:00100000:2.0:1783969512.835431:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099327744 00000004:00080000:2.0:1783969512.835449:0:17857:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783969512.835596:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099327872 00000100:00100000:1.0:1783969512.835601:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099327872 00000100:00100000:1.0:1783969512.835761:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783969512.835772:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099327872:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1783969512.835933:0:17857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 574963551220ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783969512.835942:0:17857:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1783969512.836015:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783969512.836022:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099327744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969512.836225:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870627099327744:12345-0@lo:400:kworker.0 Request processed in 203us (14314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969512.836232:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783969512.836309:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099327872:12345-0@lo:400:kworker.0 Request processed in 540us (14163us total) trans 0 rc 0/0 00010000:00080000:3.0:1783969512.836313:0:17858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea865a8000 x1870627099328256/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783969528 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969512.836322:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783969512.836329:0:17858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1870627099328256:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1783969512.836343:0:17858:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783969512.836356:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099328640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969512.836399:0:17858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1870627099328768:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783969512.836428:0:17858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.836447:0:17858:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7300 going to sleep for 11 seconds 00002000:00080000:2.0:1783969512.836449:0:18620:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1783969512.836455:0:18620:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1783969512.836462:0:18620:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:3.0:1783969512.836476:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099328768 00000100:00100000:3.0:1783969512.836479:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099328768 00000100:00100000:3.0:1783969512.836506:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969512.836513:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17858:x1870627099328768:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783969512.836542:0:18622:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1783969512.836577:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17858:x1870627099328768:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.836584:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1783969512.836609:0:17858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea865a8000 x1870627099328768/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969528 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969512.836618:0:17858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1870627099328768:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1783969512.836628:0:17858:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783969512.839771:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969512.839889:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969512.839904:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099328384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969512.839941:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969512.839979:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099328384 00000100:00100000:1.0:1783969512.839984:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099328640 00000100:00100000:1.0:1783969512.839987:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099328640 00000100:00100000:0.0:1783969512.839988:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099328384 00000100:00100000:1.0:1783969512.840031:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783969512.840031:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969512.840038:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099328640:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783969512.840039:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1870627099328384:12345-0@lo:13:osp-pre-1-0.0 00000004:00000024:1.0:1783969512.840068:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00002000:00000024:0.0:1783969512.840068:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783969512.840110:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099328640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969512.840118:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1783969512.840550:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969512.840555:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969512.840558:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969512.840571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.840602:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099327616:0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.840631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.840655:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099328128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969512.840679:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.840708:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099326976 00000100:00100000:3.0:1783969512.840712:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099326976 00000100:00100000:3.0:1783969512.840736:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099327616 00000100:00100000:3.0:1783969512.840739:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099327616 00000100:00100000:3.0:1783969512.840761:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783969512.840767:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099326976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.840804:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099326976:12345-0@lo:400:kworker.0 Request processed in 36us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.840811:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783969512.840824:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783969512.840839:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea865a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099327616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.840870:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea865a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099327616:12345-0@lo:400:kworker.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.840876:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783969512.840897:0:18624:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1783969512.840903:0:18624:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:3.0:1783969512.840916:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969512.840932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.840953:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099328000:0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.840980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969512.841013:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099326720:0@lo:400:kworker.0 00010000:00080000:3.0:1783969512.841044:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf852300 x1870627099326976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969512.841055:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099326976:0@lo:400:kworker.0 00010000:00080000:3.0:1783969512.841065:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779ca80 x1870627099327616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969512.841074:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099327616:0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.841091:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099327488 00000100:00100000:3.0:1783969512.841095:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099327488 00000100:00100000:3.0:1783969512.841110:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099328000 00000100:00100000:3.0:1783969512.841113:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099328000 00000100:00100000:3.0:1783969512.841133:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783969512.841139:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099327488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.841174:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870627099327488:12345-0@lo:400:kworker.0 Request processed in 34us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.841189:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783969512.841203:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783969512.841209:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099328000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969512.841238:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870627099328000:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969512.841243:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1783969512.841255:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783969512.841270:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabf851c00 x1870627099327488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969512.841291:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870627099327488:0@lo:400:kworker.0 00010000:00080000:3.0:1783969512.841302:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779c700 x1870627099328000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969512.841310:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1870627099328000:0@lo:400:kworker.0 00000100:00100000:0.0:1783969512.842044:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1870627099328384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2002us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969512.842067:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969512.842084:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099328128 00000100:00100000:0.0:1783969512.842089:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099328128 00000100:00100000:0.0:1783969512.842109:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969512.842115:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870627099328128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969512.842133:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783969512.842181:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870627099328128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969512.842187:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:0.0:1783969512.842418:0:17092:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:1.0:1783969512.844114:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779d880 x1870627099328384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969512.844143:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099328384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969512.844162:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099328640:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1783969512.844221:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779fb80 x1870627099327872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969512.844231:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099327872:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.844242:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099326464:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.844252:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099327104:0@lo:400:kworker.0 00010000:00080000:1.0:1783969512.844274:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab779ed80 x1870627099327744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969512.844296:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1870627099327744:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.844323:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099326592:0@lo:400:kworker.0 00000100:00100000:1.0:1783969512.844333:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099327232:0@lo:400:kworker.0 00010000:00080000:3.0:1783969512.844569:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea865ab800 x1870627099328128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969512.844584:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099328128:0@lo:13:osp-pre-1-1.0 00002000:00010000:2.0:1783969512.846687:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969512.846702:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.846722:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1783969512.846727:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969512.846733:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.846769:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.846780:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.846788:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.846811:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783969512.846872:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969512.846879:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.846887:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bde00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969512.846891:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.846911:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.846928:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.846935:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4048eea/0xea31253a47cbb028 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.846953:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969512.846955:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969512.846956:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969512.849645:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783969512.849659:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.849676:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=574s v=(0 0) 00010000:00010000:2.0:1783969512.849681:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969512.849687:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.849702:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.849712:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.849733:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.849811:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783969512.850234:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783969512.850241:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850251:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=574s v=(0 0) 00010000:00010000:3.0:1783969512.850255:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969512.850260:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850271:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850294:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850309:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850333:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783969512.850502:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969512.850509:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850518:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bc000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969512.850522:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850532:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850548:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850556:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049aa383a/0xea31253a47cbb02f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850574:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969512.850578:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850583:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969512.850594:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850601:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850611:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850617:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000167b6b3a/0xea31253a47cbb036 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.850629:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.850631:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.850632:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783969512.850870:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783969512.850876:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850884:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=574s v=(0 0) 00010000:00010000:3.0:1783969512.850887:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969512.850892:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850901:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850908:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850915:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.850935:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969512.851051:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969512.851055:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.851063:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969512.851065:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.851073:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.851084:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.851098:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055bc6494/0xea31253a47cbb03d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.851112:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.851114:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.851116:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783969512.851494:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783969512.851501:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.851525:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=574s v=(0 0) 00010000:00010000:3.0:1783969512.851528:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969512.851533:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.851543:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.851550:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.851557:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.851565:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969512.851571:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783969512.851774:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969512.851779:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.851787:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52a00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969512.851791:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.851799:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.851833:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.851841:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c4a9560/0xea31253a47cbb044 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969512.851854:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969512.851856:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969512.851858:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.852158:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.852165:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852174:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.852178:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.852182:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852193:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852203:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852210:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852238:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969512.852542:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.852549:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.852558:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797e00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.852561:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.852568:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.852583:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.852590:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f413515/0xea31253a47cbb04b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.852607:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.852609:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.852610:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.852843:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.852849:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852858:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.852861:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.852866:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852875:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852883:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852889:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.852904:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783969512.853155:0:17846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1783969512.853243:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.853249:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.853257:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.853266:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.853271:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.853293:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.853302:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.853309:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.853328:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783969512.853447:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969512.853452:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853460:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.853465:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853473:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853485:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853493:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016cc5d3c/0xea31253a47cbb052 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853510:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.853513:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853520:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797a00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.853524:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853532:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853551:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853559:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6dd15b4/0xea31253a47cbb059 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.853572:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.853575:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.853577:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969512.853682:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.853879:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.853884:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.853893:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.853896:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.853900:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.853909:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.853916:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.853930:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.854035:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969512.854319:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.854325:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.854335:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.854338:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.854343:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.854353:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.854373:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.854402:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856115:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969512.856129:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856143:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.856148:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856159:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856178:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856185:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008571074a/0xea31253a47cbb060 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856229:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.856233:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856240:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796e00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.856243:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856251:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856262:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.856269:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.856270:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.856272:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969512.856399:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969512.856407:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aab278b/0xea31253a47cbb067 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969512.857164:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.857173:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.857187:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.857192:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.857199:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.857212:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.857221:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.857230:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.857317:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.857323:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.857331:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.857335:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.857357:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.857502:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.857559:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.857561:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.857564:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969512.857605:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969512.857610:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065ec9147/0xea31253a47cbb06e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.857954:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.858031:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.858037:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.858056:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.858059:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.858064:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.858074:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.858081:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.858087:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.858137:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969512.858481:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.858487:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.858495:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.858499:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.858503:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.858512:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.858532:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.858539:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858772:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969512.858778:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858785:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969512.858789:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858797:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858809:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858815:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ba7e79d/0xea31253a47cbb075 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858841:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969512.858845:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858851:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969512.858854:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858861:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858872:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.858879:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.858881:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.858883:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969512.858943:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969512.858948:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015b6a0ab/0xea31253a47cbb07c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969512.859224:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.859230:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.859238:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.859241:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.859245:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.859254:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.859261:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.859289:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.859317:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.859322:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.859329:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7796200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.859332:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.859339:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.859350:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.859356:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.859358:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.859360:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969512.859520:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969512.859525:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e84b74/0xea31253a47cbb083 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969512.860169:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.860176:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.860185:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.860188:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.860192:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.860201:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.860208:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.860215:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.860256:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969512.860261:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.860267:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:2.0:1783969512.860270:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.860299:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.860309:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969512.860317:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.860318:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969512.860320:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969512.861731:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969512.861741:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc9027e9/0xea31253a47cbb08a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.862171:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.862509:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.862517:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.862530:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.862534:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.862540:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.862553:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.862562:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.862570:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.862594:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969512.862721:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.862732:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.862740:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797400 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.862745:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.862754:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.862769:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.862777:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee7718ae/0xea31253a47cbb091 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.862815:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.862817:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.862818:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.863225:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.863231:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863246:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.863249:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.863254:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863262:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863270:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863286:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863312:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969512.863320:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969512.863324:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863331:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93eab7797c00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969512.863334:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863341:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863362:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863397:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013d8df4b/0xea31253a47cbb098 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863412:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969512.863414:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969512.863416:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.863837:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.863843:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863852:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.863855:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.863860:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863869:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863878:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.863885:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.864006:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969512.864272:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.864290:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.864298:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.864301:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.864305:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.864313:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.864321:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.864328:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.865927:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969512.865942:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.865958:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80030a00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.865962:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.865986:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.866005:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.866013:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0e95214/0xea31253a47cbb09f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.866043:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.866048:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.866054:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80031e00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.866057:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.866064:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.866074:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.866080:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.866082:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.866090:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969512.866631:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969512.866641:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000151c9ed8/0xea31253a47cbb0a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.867099:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.867215:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.867222:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867242:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.867246:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.867253:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867266:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867289:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867297:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867316:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969512.867637:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.867644:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.867653:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80031000 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.867657:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.867665:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.867681:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.867688:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019d2d596/0xea31253a47cbb0ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.867708:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.867710:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.867712:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.867886:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.867892:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867900:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.867903:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.867907:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867917:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867935:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867942:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.867962:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969512.868260:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.868266:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868286:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.868289:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.868293:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868303:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868310:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868316:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868340:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783969512.868666:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.868672:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868680:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.868684:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.868687:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868695:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868703:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868710:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.868718:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783969512.868990:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783969512.868995:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869003:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80030c00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.869007:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869022:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869035:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869042:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c0d98cb/0xea31253a47cbb0b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869062:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969512.869066:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869073:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80030600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.869076:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869084:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869093:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869101:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083d62dd6/0xea31253a47cbb0bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869127:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.869131:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869137:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80031200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.869140:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869148:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869158:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869166:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e46eeb4f/0xea31253a47cbb0c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869179:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.869181:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.869183:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.869189:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.869319:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.869325:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869334:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.869344:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.869349:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869360:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869418:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869428:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869444:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969512.869582:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.869587:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869594:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea80031a00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.869603:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869612:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869623:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869631:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c504b71/0xea31253a47cbb0c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.869647:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.869649:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.869651:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.869892:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.869899:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869907:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.869909:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.869913:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869922:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869930:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869943:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.869962:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969512.870076:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.870081:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.870088:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddca00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.870091:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.870099:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.870109:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.870123:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000854e5ac8/0xea31253a47cbb0d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.870138:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.870139:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.870142:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969512.870335:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.870341:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870349:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.870353:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.870357:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870377:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870409:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870416:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870430:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969512.870707:0:18620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783969512.870713:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870727:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=574s v=(0 0) 00010000:00010000:0.0:1783969512.870730:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969512.870734:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870743:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870751:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870757:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969512.870770:0:18620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1783969512.870797:0:18620:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1783969512.870891:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17139:x1870627099328512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 38719us (39089us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969512.870901:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969512.870959:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17139:1870627099328512:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783969512.870977:0:17139:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1783969512.871024:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17139:1870627099328896:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783969512.871059:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969512.871083:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff93e983fe29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969512.871107:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099328896 00000100:00100000:0.0:1783969512.871113:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099328896 00000100:00100000:0.0:1783969512.871158:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969512.871166:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17139:x1870627099328896:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783969512.871203:0:18620:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:1.0:1783969512.871317:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969512.871324:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871333:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddda00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.871337:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871344:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871357:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871373:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb0d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871408:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969512.871411:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871425:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddc600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:1.0:1783969512.871428:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871434:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871444:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871450:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000218c63c7/0xea31253a47cbb0de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969512.871463:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.871465:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.871467:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969512.871481:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783969512.882337:0:19435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1783969512.882417:0:19435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783969512.882422:0:19435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783969512.882932:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17139:x1870627099328896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11759us (11865us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783969512.882946:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969512.883042:0:17139:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783969512.883051:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17139:1870627099328896:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783969512.883067:0:17139:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1783969513.328632:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969513.328658:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099329024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969513.328732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969513.329137:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099329024 00000100:00100000:3.0:1783969513.329147:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099329024 00000100:00100000:3.0:1783969513.329210:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783969513.329220:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099329024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969513.329259:0:17854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783969513.329331:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099329024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969513.329338:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969513.329436:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099329024:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783969513.718765:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969514.097229:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783969514.744127:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783969515.093211:0:19791:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783969515.762051:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969515.888591:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969515.888615:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099329152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969515.888689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969515.888775:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099329152 00000100:00100000:0.0:1783969515.888783:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099329152 00000100:00100000:0.0:1783969515.888848:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783969515.888862:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099329152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969515.888891:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783969515.888934:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099329152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969515.888941:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1783969515.888991:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969515.889027:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099329152:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1783969516.258467:0:19843:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783969516.258793:0:19843:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783969516.786588:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969516.912599:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099329280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783969516.912675:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969516.912827:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099329280 00000100:00100000:2.0:1783969516.912836:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099329280 00000100:00100000:2.0:1783969516.912915:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783969516.912925:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099329280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783969516.912946:0:19683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783969516.912990:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099329280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969516.913011:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969516.913011:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099329280:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783969516.913066:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1783969517.446886:0:19893:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783969517.447193:0:19893:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783969517.808626:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969517.936797:0:17858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1870627099329536:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783969517.936869:0:17858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969517.936939:0:17858:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e80f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969517.937034:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099329536 00000100:00100000:2.0:1783969517.937042:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099329536 00000100:00100000:2.0:1783969517.937107:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783969517.937116:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17858:x1870627099329536:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1783969517.937156:0:18621:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:0.0:1783969517.937775:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969517.937790:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099329408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969517.937829:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969517.938014:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099329408 00000100:00100000:2.0:1783969517.938020:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099329408 00000100:00100000:2.0:1783969517.938051:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969517.938058:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870627099329408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783969517.938072:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783969517.938126:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870627099329408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969517.938133:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969517.938182:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099329408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969517.938925:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099329664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969517.938962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969517.938991:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969517.938998:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099329792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969517.939020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969517.939055:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099329792 00000100:00100000:1.0:1783969517.939059:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099329792 00000100:00100000:1.0:1783969517.939088:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969517.939094:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099329792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969517.939109:0:19683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783969517.939144:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099329792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.939150:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969517.939181:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099329792:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783969517.939271:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969517.939303:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099329664 00000100:00100000:3.0:1783969517.939307:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099329664 00000100:00100000:3.0:1783969517.939342:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783969517.939349:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099329664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969517.939373:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783969517.939431:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099329664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969517.939437:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783969517.940035:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099329920:0@lo:400:kworker.0 00000100:00100000:2.0:1783969517.940073:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969517.940103:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099330432:0@lo:400:kworker.0 00000100:00100000:2.0:1783969517.940124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969517.940138:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099330944:0@lo:400:kworker.0 00000100:00100000:2.0:1783969517.940157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969517.940171:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783969517.940176:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099330048:0@lo:400:kworker.0 00000100:00100000:2.0:1783969517.940221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969517.940235:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099330560:0@lo:400:kworker.0 00000100:00100000:2.0:1783969517.940256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969517.940270:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099331072:0@lo:400:kworker.0 00000100:00100000:2.0:1783969517.940322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969517.941008:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099330048 00000100:00100000:1.0:1783969517.941014:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099330048 00000100:00100000:1.0:1783969517.941044:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783969517.941051:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099330048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941105:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099330048:12345-0@lo:400:kworker.0 Request processed in 54us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.941111:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783969517.941137:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099330944 00000100:00100000:1.0:1783969517.941140:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099330944 00000100:00100000:1.0:1783969517.941165:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099330560 00000100:00100000:1.0:1783969517.941168:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099330560 00000100:00100000:1.0:1783969517.941178:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099331072 00000100:00100000:1.0:1783969517.941180:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099331072 00000100:00100000:1.0:1783969517.941207:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783969517.941214:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099330944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941243:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099330944:12345-0@lo:400:kworker.0 Request processed in 30us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.941255:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783969517.941266:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969517.941271:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941311:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099330560:12345-0@lo:400:kworker.0 Request processed in 40us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.941316:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969517.941325:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969517.941330:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099331072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941351:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099331072:12345-0@lo:400:kworker.0 Request processed in 22us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.941357:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969517.941400:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099330304:0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969517.941445:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099330816:0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941462:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969517.941477:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783969517.941483:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099330176:0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969517.941519:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099330688:0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969517.941551:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099330304 00000100:00100000:1.0:1783969517.941553:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099330304 00000100:00100000:1.0:1783969517.941567:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099330816 00000100:00100000:1.0:1783969517.941569:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099330816 00000100:00100000:1.0:1783969517.941579:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099330688 00000100:00100000:1.0:1783969517.941586:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099330688 00000100:00100000:1.0:1783969517.941601:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783969517.941605:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099330304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941635:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099330304:12345-0@lo:400:kworker.0 Request processed in 29us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.941640:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783969517.941649:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783969517.941654:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099330816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941676:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099330816:12345-0@lo:400:kworker.0 Request processed in 23us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.941681:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783969517.941691:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783969517.941695:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099330688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941716:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099330688:12345-0@lo:400:kworker.0 Request processed in 21us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.941721:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783969517.941759:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099329664:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1783969517.941788:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e3800 x1870627099330688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969517.941798:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099330688:0@lo:400:kworker.0 00010000:00080000:1.0:1783969517.941809:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e3b80 x1870627099330304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969517.941815:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099330304:0@lo:400:kworker.0 00010000:00080000:1.0:1783969517.941823:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e1c00 x1870627099330816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969517.941839:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099330816:0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941872:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099330048:0@lo:400:kworker.0 00010000:00080000:1.0:1783969517.941881:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e0a80 x1870627099330560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969517.941889:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099330560:0@lo:400:kworker.0 00010000:00080000:1.0:1783969517.941897:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93ea85f95c00 x1870627099331072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969517.941903:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099331072:0@lo:400:kworker.0 00010000:00080000:1.0:1783969517.941912:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983d20a80 x1870627099330944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969517.941919:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099330944:0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.941961:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099330432 00000100:00100000:1.0:1783969517.941965:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099330432 00000100:00100000:1.0:1783969517.941987:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099330176 00000100:00100000:1.0:1783969517.941990:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099330176 00000100:00100000:1.0:1783969517.942010:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969517.942015:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099330432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.942055:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099330432:12345-0@lo:400:kworker.0 Request processed in 38us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.942061:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969517.942072:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969517.942078:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099330176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.942119:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099330176:12345-0@lo:400:kworker.0 Request processed in 41us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.942126:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969517.942149:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099330176:0@lo:400:kworker.0 00000100:00100000:1.0:1783969517.942171:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099330432:0@lo:400:kworker.0 00000100:00100000:0.0:1783969517.943242:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099329920 00000100:00100000:0.0:1783969517.943254:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099329920 00000100:00100000:0.0:1783969517.943306:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783969517.943314:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+24:3648:x1870627099329920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969517.943370:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+24:3648:x1870627099329920:12345-0@lo:400:kworker.0 Request processed in 58us (3296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969517.943375:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783969517.943533:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099329920:0@lo:400:kworker.0 00000100:00080000:3.0:1783969517.945787:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969517.945796:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783969517.945799:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969517.950415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969517.951406:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074070144 00000100:00100000:0.0:1783969517.951419:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074070144 00000100:00100000:0.0:1783969517.951476:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:0.0:1783969517.951484:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2390:x1870627074070144:12345-192.168.201.34@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783969517.951511:0:17107:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 67a3c0e1-9e25-4885-b9a1-31708fbd2c77@192.168.201.34@tcp t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:0.0:1783969517.951539:0:17107:0:(genops.c:1406:class_connect()) connect: client 67a3c0e1-9e25-4885-b9a1-31708fbd2c77, cookie 0xea31253a47cbb0e5 00000100:00080000:0.0:1783969517.951674:0:17107:0:(import.c:65:import_set_state_nolock()) ffff93e983e4f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969517.951750:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+5:2390:x1870627074070144:12345-192.168.201.34@tcp:250:mount.lustre.0 Request processed in 264us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969517.951758:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:0.0:1783969517.962973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969517.963073:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074070272 00000100:00100000:1.0:1783969517.963083:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074070272 00000100:00100000:1.0:1783969517.963139:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:1.0:1783969517.963149:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+5:14899:x1870627074070272:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783969517.963166:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969517.963186:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983de7e00/0xea31253a47cbb0ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303bd5 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969517.963228:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de7e00/0xea31253a47cbb0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bd5 expref: 6 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969517.963240:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983de7e00/0xea31253a47cbb0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bd5 expref: 6 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969517.963249:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7e00, rc 0) 00000100:00100000:1.0:1783969517.963314:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+6:14899:x1870627074070272:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 166us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.963321:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:0.0:1783969517.968774:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17858:x1870627099329536:12345-0@lo:5:osp-pre-1-1.0 Request processed in 31649us (31895us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783969517.968789:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783969517.972533:0:17858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1870627099329536:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1783969517.972554:0:17858:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1783969517.972608:0:17858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabbff0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17858:1870627099331200:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1783969517.972666:0:17858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969517.972691:0:17858:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e80f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969517.973052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969517.973190:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074070400 00000100:00100000:1.0:1783969517.973207:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074070400 00000100:00100000:1.0:1783969517.973267:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:1.0:1783969517.973287:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+6:14899:x1870627074070400:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783969517.973432:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+6:14899:x1870627074070400:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 155us (381us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783969517.973440:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:0.0:1783969517.974862:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099331200 00000100:00100000:0.0:1783969517.974872:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099331200 00000100:00100000:0.0:1783969517.974922:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969517.974931:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17858:x1870627099331200:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783969517.975172:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17858:x1870627099331200:12345-0@lo:900:osp-pre-1-1.0 Request processed in 241us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969517.975202:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783969517.975435:0:17858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eabbff0000 x1870627099331200/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783969533 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969517.975451:0:17858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabbff0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17858:1870627099331200:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1783969517.980736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969517.980908:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074070528 00000100:00100000:0.0:1783969517.980919:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074070528 00000100:00100000:0.0:1783969517.980987:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1783969517.981006:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+6:14899:x1870627074070528:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783969517.981024:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969517.981044:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983ddce00/0xea31253a47cbb0f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303bdc expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969517.981076:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983ddce00/0xea31253a47cbb0f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bdc expref: 7 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969517.981086:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983ddce00/0xea31253a47cbb0f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303bdc expref: 7 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969517.981096:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddce00, rc 0) 00000100:00100000:0.0:1783969517.981157:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+7:14899:x1870627074070528:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 160us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969517.981163:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:3.0:1783969517.987075:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969517.987234:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074070656 00000100:00100000:2.0:1783969517.987244:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074070656 00000100:00100000:2.0:1783969517.987328:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:2.0:1783969517.987339:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+7:14899:x1870627074070656:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783969517.987556:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14899:x1870627074070656:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 219us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969517.987564:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:2.0:1783969517.997865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969517.997970:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074070784 00000100:00100000:1.0:1783969517.997980:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074070784 00000100:00100000:1.0:1783969517.998051:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:1.0:1783969517.998061:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14899:x1870627074070784:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783969517.998218:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14899:x1870627074070784:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 157us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969517.998226:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:3.0:1783969518.003653:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969518.003766:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074070912 00000100:00100000:0.0:1783969518.003776:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074070912 00000100:00100000:0.0:1783969518.003843:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:0.0:1783969518.003854:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14917:x1870627074070912:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969518.004020:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14917:x1870627074070912:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969518.004029:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:3.0:1783969518.057667:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969518.057791:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074071040 00000100:00100000:2.0:1783969518.057802:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074071040 00000100:00100000:2.0:1783969518.057866:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:2.0:1783969518.057877:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14917:x1870627074071040:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969518.058056:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14917:x1870627074071040:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 180us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969518.058065:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:2.0:1783969518.071557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969518.072013:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074071168 00000100:00100000:1.0:1783969518.072023:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074071168 00000100:00100000:1.0:1783969518.072080:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:1.0:1783969518.072089:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14917:x1870627074071168:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783969518.072276:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14917:x1870627074071168:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 187us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969518.072292:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:3.0:1783969518.099306:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969518.099466:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074071296 00000100:00100000:0.0:1783969518.099475:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074071296 00000100:00100000:0.0:1783969518.099545:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:0.0:1783969518.099555:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+8:14899:x1870627074071296:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783969518.099571:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969518.099587:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983ddd400/0xea31253a47cbb0fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303c0d expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969518.099614:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983ddd400/0xea31253a47cbb0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c0d expref: 9 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969518.099624:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983ddd400/0xea31253a47cbb0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c0d expref: 9 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969518.099632:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddd400, rc 0) 00000100:00100000:0.0:1783969518.099688:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+9:14899:x1870627074071296:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 134us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969518.099694:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:3.0:1783969518.102921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969518.103137:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074071424 00000100:00100000:2.0:1783969518.103147:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074071424 00000100:00100000:2.0:1783969518.103215:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 128 00000100:00100000:2.0:1783969518.103226:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+9:14899:x1870627074071424:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783969518.103253:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783969518.103293:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783969518.103298:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783969518.103302:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783969518.103305:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783969518.103308:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1783969518.106970:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+9:14899:x1870627074071424:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 3736us (4050us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969518.106984:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 128 00000100:00100000:3.0:1783969518.112607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969518.112750:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074071552 00000100:00100000:1.0:1783969518.112760:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074071552 00000100:00100000:1.0:1783969518.112816:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:1.0:1783969518.112827:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+9:14899:x1870627074071552:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783969518.112854:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969518.112874:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303c14 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969518.112906:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c14 expref: 10 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969518.112918:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c14 expref: 10 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969518.112927:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7a00, rc 0) 00000100:00100000:1.0:1783969518.112991:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:14899:x1870627074071552:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 165us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969518.112999:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:3.0:1783969518.115958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969518.116528:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074071680 00000100:00100000:1.0:1783969518.116537:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074071680 00000100:00100000:1.0:1783969518.116652:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:1.0:1783969518.116662:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:14899:x1870627074071680:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783969518.116836:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:14899:x1870627074071680:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 174us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969518.116844:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:2.0:1783969518.127083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969518.148586:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074071808 00000100:00100000:0.0:1783969518.148603:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074071808 00000100:00100000:0.0:1783969518.148677:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:0.0:1783969518.148688:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:14899:x1870627074071808:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783969518.148869:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:14899:x1870627074071808:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 182us (21793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969518.148877:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:3.0:1783969518.162567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969518.162700:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074071936 00000100:00100000:0.0:1783969518.162713:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074071936 00000100:00100000:0.0:1783969518.162821:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:0.0:1783969518.162834:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:14923:x1870627074071936:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969518.163000:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:14923:x1870627074071936:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 168us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969518.163009:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:2.0:1783969518.177281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969518.177492:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074072064 00000100:00100000:3.0:1783969518.177502:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074072064 00000100:00100000:3.0:1783969518.177550:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:3.0:1783969518.177561:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:14923:x1870627074072064:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783969518.177715:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:14923:x1870627074072064:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 155us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969518.177722:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 133 00000040:00080000:2.0:1783969518.193111:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783969518.202861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969518.202958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969518.203075:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074072192 00000100:00100000:1.0:1783969518.203086:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074072192 00000100:00100000:1.0:1783969518.203123:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074072448 00000100:00100000:1.0:1783969518.203126:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074072448 00000100:00100000:1.0:1783969518.203157:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1783969518.203166:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1870627074072192:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783969518.203231:0:17113:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 1a97a32d-150e-48b4-af23-95f3386e92f5@192.168.201.34@tcp t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:1.0:1783969518.203291:0:17113:0:(genops.c:1406:class_connect()) connect: client 1a97a32d-150e-48b4-af23-95f3386e92f5, cookie 0xea31253a47cbb108 00000004:00100000:1.0:1783969518.203323:0:17113:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1783969518.203678:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1783969518.203692:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1870627074072448:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783969518.203728:0:17114:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 1a97a32d-150e-48b4-af23-95f3386e92f5@192.168.201.34@tcp t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:0.0:1783969518.203783:0:17114:0:(genops.c:1406:class_connect()) connect: client 1a97a32d-150e-48b4-af23-95f3386e92f5, cookie 0xea31253a47cbb10f 00000004:00100000:0.0:1783969518.203810:0:17114:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783969518.204140:0:17113:0:(import.c:65:import_set_state_nolock()) ffff93ea86fcc000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783969518.204176:0:17114:0:(import.c:65:import_set_state_nolock()) ffff93e983e4b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969518.204250:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2390:x1870627074072192:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 1079us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969518.204267:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1783969518.204267:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2390:x1870627074072448:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 562us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969518.204438:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1783969518.213932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969518.213977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969518.214009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969518.214140:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074072704 00000100:00100000:1.0:1783969518.214149:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074072704 00000100:00100000:1.0:1783969518.214223:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074072576 00000100:00100000:1.0:1783969518.214227:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074072576 00000100:00100000:1.0:1783969518.214246:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074072320 00000100:00100000:1.0:1783969518.214248:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074072320 00000100:00080000:2.0:1783969518.214477:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969518.214483:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969518.214524:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1783969518.214537:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+7:14899:x1870627074072704:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783969518.214569:0:19100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783969518.214812:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1783969518.214840:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+6:0:x1870627074072576:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783969518.214883:0:17114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783969518.214993:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+7:14899:x1870627074072704:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 455us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969518.215002:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1783969518.215026:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1783969518.215034:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+6:0:x1870627074072320:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783969518.215049:0:19100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783969518.220953:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+6:0:x1870627074072576:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 6108us (6954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969518.220967:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+6:0:x1870627074072320:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 5917us (6939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969518.220979:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1783969518.220992:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1783969518.223276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969518.223468:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074072832 00000100:00100000:3.0:1783969518.223478:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074072832 00000100:00100000:3.0:1783969518.223536:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1783969518.223546:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14899:x1870627074072832:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783969518.223624:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14899:x1870627074072832:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 78us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969518.223630:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1783969518.225949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969518.225995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969518.226027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969518.226059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969518.226087:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074072960 00000100:00100000:2.0:1783969518.226095:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074072960 00000100:00100000:2.0:1783969518.226127:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074073088 00000100:00100000:2.0:1783969518.226130:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074073088 00000100:00100000:2.0:1783969518.226145:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1783969518.226152:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1870627074072960:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783969518.226213:0:18622:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1a97a32d-150e-48b4-af23-95f3386e92f5@192.168.201.34@tcp t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:2.0:1783969518.226247:0:18622:0:(genops.c:1406:class_connect()) connect: client 1a97a32d-150e-48b4-af23-95f3386e92f5, cookie 0xea31253a47cbb116 00002000:00100000:2.0:1783969518.226260:0:18622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1a97a32d-150e-48b4-af23-95f3386e92f5/ffff93eab9fc4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969518.226277:0:18622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783969518.226366:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074073344 00000100:00100000:3.0:1783969518.226370:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074073344 00000100:00100000:3.0:1783969518.226423:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:3.0:1783969518.226442:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:2391:x1870627074073344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969518.226502:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:2391:x1870627074073344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 61us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969518.226511:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:1.0:1783969518.226652:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1783969518.226658:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1870627074073088:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783969518.226677:0:18620:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1a97a32d-150e-48b4-af23-95f3386e92f5@192.168.201.34@tcp t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:1.0:1783969518.226699:0:18620:0:(genops.c:1406:class_connect()) connect: client 1a97a32d-150e-48b4-af23-95f3386e92f5, cookie 0xea31253a47cbb11d 00002000:00100000:1.0:1783969518.226705:0:18620:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1a97a32d-150e-48b4-af23-95f3386e92f5/ffff93ea86fc8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783969518.226711:0:18620:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783969518.226875:0:18620:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783969518.226904:0:18620:0:(import.c:65:import_set_state_nolock()) ffff93ea86fcf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969518.226934:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2390:x1870627074073088:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 274us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969518.226940:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1783969518.227461:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074073216 00000100:00100000:0.0:1783969518.227467:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074073216 00000100:00100000:0.0:1783969518.227516:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1783969518.227524:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14899:x1870627074073216:12345-192.168.201.34@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783969518.227588:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14899:x1870627074073216:12345-192.168.201.34@tcp:900:mount.lustre.0 Request processed in 64us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969518.227594:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00002000:00080000:2.0:1783969518.228201:0:18622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783969518.228226:0:18622:0:(import.c:65:import_set_state_nolock()) ffff93eaac726000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969518.228272:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2390:x1870627074072960:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 2119us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969518.228289:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1783969518.234671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969518.234804:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074073472 00000100:00100000:0.0:1783969518.234814:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074073472 00000100:00100000:0.0:1783969518.234877:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1783969518.234889:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14899:x1870627074073472:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00080000:1.0:1783969518.238532:0:17115:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3557us 00000004:00200000:0.0:1783969518.262271:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783969518.262443:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14899:x1870627074073472:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 27549us (27774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969518.262454:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1783969518.446668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969518.446798:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074073600 00000100:00100000:1.0:1783969518.446807:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074073600 00000100:00100000:1.0:1783969518.446868:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1783969518.446878:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14946:x1870627074073600:12345-192.168.201.34@tcp:101:mkdir.0 00010000:00010000:1.0:1783969518.446897:0:19100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969518.446925:0:19100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbb124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303c45 expref: -99 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969518.446992:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb12b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969518.447006:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb12b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969518.447032:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb12b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969518.447085:0:19100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783969518.447089:0:19100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969518.447122:0:19100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb12b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969518.447147:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6800/0xea31253a47cbb124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c45 expref: 8 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969518.447166:0:19100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb12b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c45 expref: 7 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969518.447174:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea829f4700) 00010000:00010000:1.0:1783969518.447177:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969518.447181:0:19100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6600, rc 0) 00000100:00100000:1.0:1783969518.447258:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+7:14946:x1870627074073600:12345-192.168.201.34@tcp:101:mkdir.0 Request processed in 381us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969518.447265:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1783969518.448627:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969518.448650:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099331328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783969518.448709:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969518.448931:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099331328 00000100:00100000:2.0:1783969518.448938:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099331328 00000100:00100000:2.0:1783969518.448991:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783969518.449000:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099331328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969518.449024:0:17854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783969518.449065:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099331328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969518.449072:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783969518.449214:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e98262c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099331328:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783969518.834089:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969519.860309:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783969519.990760:0:19435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a97a32d-150e-48b4-af23-95f3386e92f5 00000001:00080000:1.0:1783969519.990775:0:19435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1783969520.709095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969520.713650:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074073728 00000100:00100000:3.0:1783969520.713665:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074073728 00000100:00080000:2.0:1783969520.713763:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969520.713776:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1783969520.713788:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+7:14998:x1870627074073728:12345-192.168.201.34@tcp:41:lfs.0 00000004:00000024:3.0:1783969520.713825:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783969520.713930:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+7:14998:x1870627074073728:12345-192.168.201.34@tcp:41:lfs.0 Request processed in 144us (4843us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969520.713938:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1783969520.719168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969520.719273:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074073856 00000100:00100000:1.0:1783969520.719283:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074073856 00000100:00100000:1.0:1783969520.719358:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:1.0:1783969520.719368:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14998:x1870627074073856:12345-192.168.201.34@tcp:41:lfs.0 00000004:00000024:1.0:1783969520.719453:0:19100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783969520.719552:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14998:x1870627074073856:12345-192.168.201.34@tcp:41:lfs.0 Request processed in 185us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969520.719560:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00080000:2.0:1783969520.720404:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969520.726345:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969520.726518:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074073984 00000100:00100000:1.0:1783969520.726528:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074073984 00000100:00100000:1.0:1783969520.726608:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1783969520.726618:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14998:x1870627074073984:12345-192.168.201.34@tcp:13:lfs.0 00002000:00000024:1.0:1783969520.726674:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783969520.726914:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a97a32d-150e-48b4-af23-95f3386e92f5+6:14998:x1870627074073984:12345-192.168.201.34@tcp:13:lfs.0 Request processed in 297us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969520.726922:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00080000:2.0:1783969520.727240:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969520.730513:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969520.732365:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074074112 00000100:00100000:1.0:1783969520.732378:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074074112 00000100:00100000:1.0:1783969520.732478:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1783969520.732488:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a97a32d-150e-48b4-af23-95f3386e92f5+5:14998:x1870627074074112:12345-192.168.201.34@tcp:13:lfs.0 00002000:00000024:1.0:1783969520.732520:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783969520.732606:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a97a32d-150e-48b4-af23-95f3386e92f5+5:14998:x1870627074074112:12345-192.168.201.34@tcp:13:lfs.0 Request processed in 120us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969520.732613:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00080000:2.0:1783969520.733584:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783969520.882369:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969520.932133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969520.932785:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074074240 00000100:00100000:0.0:1783969520.932796:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074074240 00000100:00100000:0.0:1783969520.932878:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:0.0:1783969520.932889:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+10:15029:x1870627074074240:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783969520.932914:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969520.932933:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983ddc200/0xea31253a47cbb132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303c4c expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969520.932962:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983ddc200/0xea31253a47cbb132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c4c expref: 11 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969520.932988:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983ddc200/0xea31253a47cbb132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c4c expref: 11 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969520.932998:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddc200, rc 0) 00000100:00100000:0.0:1783969520.933059:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15029:x1870627074074240:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 173us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969520.933067:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:0.0:1783969520.936114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969520.936520:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074074368 00000100:00100000:3.0:1783969520.936528:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074074368 00000100:00100000:3.0:1783969520.936632:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:3.0:1783969520.936643:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15029:x1870627074074368:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783969520.936812:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15029:x1870627074074368:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 170us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969520.936829:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:1.0:1783969520.954674:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969520.954794:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074074496 00000100:00100000:2.0:1783969520.954804:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074074496 00000100:00100000:2.0:1783969520.954889:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:2.0:1783969520.954900:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15029:x1870627074074496:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783969520.955054:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15029:x1870627074074496:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 154us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969520.955062:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:2.0:1783969520.968736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969520.968835:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074074624 00000100:00100000:3.0:1783969520.968845:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074074624 00000100:00100000:3.0:1783969520.968899:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:3.0:1783969520.968910:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15036:x1870627074074624:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783969520.969062:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15036:x1870627074074624:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 153us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969520.969071:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:1.0:1783969521.009949:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969521.009974:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099331456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969521.010042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969521.010499:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099331456 00000100:00100000:3.0:1783969521.010508:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099331456 00000100:00100000:3.0:1783969521.010589:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969521.010597:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099331456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969521.010619:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783969521.010666:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099331456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969521.010673:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1783969521.010733:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969521.010805:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099331456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969521.040981:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969521.041076:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074074752 00000100:00100000:1.0:1783969521.041086:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074074752 00000100:00100000:1.0:1783969521.041170:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:1.0:1783969521.041182:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15036:x1870627074074752:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783969521.041349:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15036:x1870627074074752:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 169us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969521.041357:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:1.0:1783969521.054197:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.054483:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074074880 00000100:00100000:2.0:1783969521.054493:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074074880 00000100:00100000:2.0:1783969521.054838:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:2.0:1783969521.054851:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15036:x1870627074074880:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969521.055018:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15036:x1870627074074880:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 168us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969521.055026:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:2.0:1783969521.059304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969521.059472:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074075008 00000100:00100000:3.0:1783969521.059482:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074075008 00000100:00100000:3.0:1783969521.059534:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:3.0:1783969521.059544:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98366c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:15029:x1870627074075008:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783969521.059560:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969521.059578:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea91a52a00/0xea31253a47cbb139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303c7d expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969521.059605:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea91a52a00/0xea31253a47cbb139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c7d expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969521.059616:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea91a52a00/0xea31253a47cbb139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c7d expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969521.059625:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52a00, rc 0) 00000100:00100000:3.0:1783969521.059683:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98366c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:15029:x1870627074075008:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 140us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969521.059690:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:0.0:1783969521.068445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969521.068540:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074075136 00000100:00100000:1.0:1783969521.068550:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074075136 00000100:00100000:1.0:1783969521.068642:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 142 00000100:00100000:1.0:1783969521.068653:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:15029:x1870627074075136:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783969521.068691:0:17106:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783969521.068715:0:17106:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783969521.068720:0:17106:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783969521.068723:0:17106:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783969521.068726:0:17106:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783969521.068729:0:17106:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1783969521.075859:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:15029:x1870627074075136:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 7198us (7413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969521.075875:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 142 00000100:00100000:2.0:1783969521.089885:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969521.095898:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074075264 00000100:00100000:3.0:1783969521.096052:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074075264 00000100:00100000:3.0:1783969521.096120:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:3.0:1783969521.096130:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:15029:x1870627074075264:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783969521.096176:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969521.096207:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303c84 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969521.096444:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c84 expref: 13 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969521.096457:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c84 expref: 13 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969521.096466:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53a00, rc 0) 00000100:00100000:3.0:1783969521.096529:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:15029:x1870627074075264:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 399us (6661us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969521.096537:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:2.0:1783969521.110941:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969521.111422:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074075392 00000100:00100000:0.0:1783969521.111430:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074075392 00000100:00100000:0.0:1783969521.111500:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:0.0:1783969521.111512:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:15029:x1870627074075392:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783969521.111665:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:15029:x1870627074075392:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 155us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969521.111673:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:1.0:1783969521.115437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969521.115639:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074075520 00000100:00100000:0.0:1783969521.115648:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074075520 00000100:00100000:0.0:1783969521.115707:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:0.0:1783969521.115718:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:15029:x1870627074075520:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783969521.116472:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:15029:x1870627074075520:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 152us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969521.116484:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:2.0:1783969521.131794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969521.132293:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074075648 00000100:00100000:3.0:1783969521.132304:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074075648 00000100:00100000:3.0:1783969521.132366:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:3.0:1783969521.132377:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea90984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:15042:x1870627074075648:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783969521.132593:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea90984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:15042:x1870627074075648:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 217us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969521.132602:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:2.0:1783969521.158255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969521.158463:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074075776 00000100:00100000:0.0:1783969521.158472:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074075776 00000100:00100000:0.0:1783969521.158550:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:0.0:1783969521.158561:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:15042:x1870627074075776:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969521.158710:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:15042:x1870627074075776:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 150us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969521.158719:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:2.0:1783969521.186444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.186534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969521.201103:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074075904 00000100:00100000:3.0:1783969521.201119:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074075904 00000100:00100000:3.0:1783969521.201229:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074076160 00000100:00100000:3.0:1783969521.201233:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074076160 00000100:00100000:3.0:1783969521.201260:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1783969521.201269:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1870627074075904:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783969521.201316:0:17113:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 968cb78a-c1fe-4a90-8549-da4cc0f9624e@192.168.201.34@tcp t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:3.0:1783969521.201356:0:17113:0:(genops.c:1406:class_connect()) connect: client 968cb78a-c1fe-4a90-8549-da4cc0f9624e, cookie 0xea31253a47cbb147 00000100:00100000:1.0:1783969521.201359:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1783969521.201365:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1870627074076160:12345-192.168.201.34@tcp:38:mount.lustre.0 00000004:00100000:3.0:1783969521.201396:0:17113:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00080000:1.0:1783969521.201396:0:17112:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 968cb78a-c1fe-4a90-8549-da4cc0f9624e@192.168.201.34@tcp t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:1.0:1783969521.201423:0:17112:0:(genops.c:1406:class_connect()) connect: client 968cb78a-c1fe-4a90-8549-da4cc0f9624e, cookie 0xea31253a47cbb14e 00000004:00100000:1.0:1783969521.201436:0:17112:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783969521.201495:0:17113:0:(import.c:65:import_set_state_nolock()) ffff93e983f9a800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783969521.207031:0:17112:0:(import.c:65:import_set_state_nolock()) ffff93eac1544000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969521.207124:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2390:x1870627074076160:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 5752us (20584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969521.207163:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1783969521.211453:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2390:x1870627074075904:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 10169us (25004us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969521.211469:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1783969521.215764:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969521.215896:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074076288 00000100:00100000:1.0:1783969521.215907:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074076288 00000100:00100000:1.0:1783969521.215986:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1783969521.215998:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:0:x1870627074076288:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783969521.216036:0:19100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1783969521.216191:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969521.216297:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:0:x1870627074076288:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 299us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969521.216305:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1783969521.228451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.228490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969521.228515:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074076416 00000100:00100000:0.0:1783969521.228525:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074076416 00000100:00100000:0.0:1783969521.228603:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074076032 00000100:00100000:0.0:1783969521.228607:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074076032 00000100:00080000:2.0:1783969521.228610:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969521.228640:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1783969521.228646:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1783969521.228650:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+7:15029:x1870627074076416:12345-192.168.201.34@tcp:41:mount.lustre.0 00000100:00100000:2.0:1783969521.228654:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+7:0:x1870627074076032:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783969521.228688:0:19100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000004:00000024:0.0:1783969521.228688:0:17114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783969521.228751:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+7:0:x1870627074076032:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 97us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969521.228759:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1783969521.230952:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15029:x1870627074076416:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 2293us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969521.230965:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1783969521.241258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969521.242499:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074076544 00000100:00100000:3.0:1783969521.242513:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074076544 00000100:00100000:3.0:1783969521.242638:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1783969521.242649:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15029:x1870627074076544:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783969521.242747:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15029:x1870627074076544:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 100us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969521.242755:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1783969521.248936:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.248975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.249008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.249030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.249046:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.249067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.249082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.249117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.249157:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074076672 00000100:00100000:2.0:1783969521.249168:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074076672 00000100:00100000:2.0:1783969521.249198:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074076800 00000100:00100000:2.0:1783969521.249201:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074076800 00000100:00100000:2.0:1783969521.249208:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074077440 00000100:00100000:2.0:1783969521.249210:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074077440 00000100:00100000:2.0:1783969521.249249:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074077568 00000100:00100000:2.0:1783969521.249252:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074077568 00000100:00100000:2.0:1783969521.249267:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1783969521.249276:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2393:x1870627074077440:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969521.249356:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2393:x1870627074077440:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 80us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969521.249363:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1783969521.249409:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1783969521.249426:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2393:x1870627074077568:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969521.249454:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2393:x1870627074077568:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969521.249460:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1783969521.249472:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1783969521.249476:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1870627074076672:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783969521.249507:0:18622:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 968cb78a-c1fe-4a90-8549-da4cc0f9624e@192.168.201.34@tcp t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:2.0:1783969521.249538:0:18622:0:(genops.c:1406:class_connect()) connect: client 968cb78a-c1fe-4a90-8549-da4cc0f9624e, cookie 0xea31253a47cbb155 00002000:00100000:2.0:1783969521.249552:0:18622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 968cb78a-c1fe-4a90-8549-da4cc0f9624e/ffff93e981abb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969521.249564:0:18622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783969521.249631:0:18622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783969521.249660:0:18622:0:(import.c:65:import_set_state_nolock()) ffff93eabf7bc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969521.249687:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2390:x1870627074076672:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 208us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969521.249693:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1783969521.249705:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:2.0:1783969521.249710:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1870627074076800:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783969521.249725:0:18622:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 968cb78a-c1fe-4a90-8549-da4cc0f9624e@192.168.201.34@tcp t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:2.0:1783969521.249740:0:18622:0:(genops.c:1406:class_connect()) connect: client 968cb78a-c1fe-4a90-8549-da4cc0f9624e, cookie 0xea31253a47cbb15c 00002000:00100000:2.0:1783969521.249745:0:18622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 968cb78a-c1fe-4a90-8549-da4cc0f9624e/ffff93eabf7bf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969521.249751:0:18622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783969521.249805:0:18622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783969521.249821:0:18622:0:(import.c:65:import_set_state_nolock()) ffff93eabf7b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969521.249853:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2390:x1870627074076800:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 141us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969521.249859:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:0.0:1783969521.249986:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074076928 00000100:00100000:0.0:1783969521.249991:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074076928 00000100:00100000:0.0:1783969521.250031:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1783969521.250041:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15029:x1870627074076928:12345-192.168.201.34@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783969521.250074:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15029:x1870627074076928:12345-192.168.201.34@tcp:900:mount.lustre.0 Request processed in 37us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969521.250080:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1783969521.251506:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074077056 00000100:00100000:1.0:1783969521.251515:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074077056 00000100:00100000:1.0:1783969521.251555:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:1.0:1783969521.251563:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2393:x1870627074077056:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969521.251608:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2393:x1870627074077056:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 45us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969521.251615:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:1.0:1783969521.251645:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074077184 00000100:00100000:1.0:1783969521.251649:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074077184 00000100:00100000:1.0:1783969521.251674:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074077312 00000100:00100000:1.0:1783969521.251677:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074077312 00000100:00100000:1.0:1783969521.251693:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1783969521.251699:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+7:2393:x1870627074077184:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969521.251738:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+7:2393:x1870627074077184:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 39us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969521.251745:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1783969521.251756:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:1.0:1783969521.251762:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2393:x1870627074077312:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969521.251782:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2393:x1870627074077312:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 20us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969521.251788:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1783969521.268639:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969521.268819:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074077696 00000100:00100000:3.0:1783969521.268830:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074077696 00000100:00100000:3.0:1783969521.268886:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1783969521.268897:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15029:x1870627074077696:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783969521.268990:0:17116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783969521.269082:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15029:x1870627074077696:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 185us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969521.269090:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:0.0:1783969521.547505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969521.547919:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074077824 00000100:00100000:2.0:1783969521.547936:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074077824 00000100:00100000:2.0:1783969521.548012:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1783969521.548023:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15065:x1870627074077824:12345-192.168.201.34@tcp:101:mkdir.0 00010000:00010000:2.0:1783969521.548044:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969521.548078:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bce00/0xea31253a47cbb163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303cb5 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969521.548158:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969521.548173:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969521.548184:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969521.548233:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783969521.548237:0:17112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969521.548260:0:17112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969521.548284:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bce00/0xea31253a47cbb163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cb5 expref: 8 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969521.548302:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cb5 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969521.548326:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea829f4700) 00010000:00010000:2.0:1783969521.548330:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969521.548333:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bd400, rc 0) 00000100:00100000:2.0:1783969521.548447:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+7:15065:x1870627074077824:12345-192.168.201.34@tcp:101:mkdir.0 Request processed in 426us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969521.548455:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00010000:00010000:0.0:1783969521.909559:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969522.032815:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969522.037923:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099331584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783969522.038059:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969522.038320:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099331584 00000100:00100000:1.0:1783969522.038333:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099331584 00000100:00100000:1.0:1783969522.038498:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783969522.038510:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099331584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969522.038551:0:19683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783969522.038629:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099331584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969522.038637:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969522.039302:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099331584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783969522.040019:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783969522.931938:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969523.056722:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969523.056757:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099331712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969523.056853:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969523.056938:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099331712 00000100:00100000:1.0:1783969523.056947:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099331712 00000100:00100000:1.0:1783969523.057024:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783969523.057036:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099331712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969523.057078:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783969523.057141:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099331712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969523.057164:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783969523.057240:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab779ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099331712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969523.060236:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099331840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969523.060334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969523.060440:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099331840 00000100:00100000:3.0:1783969523.060451:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099331840 00000100:00100000:3.0:1783969523.060514:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783969523.060525:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099331840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969523.060578:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783969523.060635:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099331840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969523.060643:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783969523.060701:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099331840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969523.067289:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099332096:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.067411:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969523.067465:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099332608:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.067492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969523.067514:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099333120:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.067549:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969523.068421:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783969523.068436:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099332224:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.068482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969523.068509:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea865ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099332736:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.068532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969523.068551:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099333248:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.068675:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969523.068726:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099332096 00000100:00100000:3.0:1783969523.068736:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099332096 00000100:00100000:3.0:1783969523.068793:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783969523.068803:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099332096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.068873:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099332096:12345-0@lo:400:kworker.0 Request processed in 70us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969523.068881:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783969523.068911:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099332608 00000100:00100000:3.0:1783969523.068915:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099332608 00000100:00100000:3.0:1783969523.068953:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099332224 00000100:00100000:3.0:1783969523.068956:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099332224 00000100:00100000:3.0:1783969523.068979:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969523.068986:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099332608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.069020:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099332608:12345-0@lo:400:kworker.0 Request processed in 35us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969523.069026:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969523.069037:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969523.069043:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099332224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.069071:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099332224:12345-0@lo:400:kworker.0 Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969523.069077:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969523.069096:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099333120 00000100:00100000:3.0:1783969523.069100:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099333120 00000100:00100000:3.0:1783969523.069141:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099332736 00000100:00100000:3.0:1783969523.069144:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099332736 00000100:00100000:3.0:1783969523.069155:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099333248 00000100:00100000:3.0:1783969523.069157:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099333248 00000100:00100000:3.0:1783969523.069181:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783969523.069187:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099333120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.073443:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099333120:12345-0@lo:400:kworker.0 Request processed in 4242us (5879us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969523.073463:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783969523.073511:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783969523.073524:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099332736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.076427:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099332736:12345-0@lo:400:kworker.0 Request processed in 2891us (7876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969523.076450:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783969523.076508:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783969523.076532:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099333248:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783969523.076730:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969523.076738:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969523.076743:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969523.076747:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969523.080023:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099331968:0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.080109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969523.080174:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099332480:0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.080215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969523.080235:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099332992:0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.080281:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969523.080310:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783969523.080317:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099332352:0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.080339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969523.080352:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099332864:0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.080371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969523.080412:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099332992 00000100:00100000:2.0:1783969523.080421:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099332992 00000100:00100000:2.0:1783969523.080484:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099332352 00000100:00100000:2.0:1783969523.080487:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099332352 00000100:00100000:2.0:1783969523.080497:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099332864 00000100:00100000:2.0:1783969523.080499:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099332864 00000100:00100000:2.0:1783969523.080515:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783969523.080523:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099332992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.080600:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870627099332992:12345-0@lo:400:kworker.0 Request processed in 75us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969523.080608:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783969523.080630:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783969523.080636:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099332352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.080663:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870627099332352:12345-0@lo:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969523.080669:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783969523.080680:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783969523.080686:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099332864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.080711:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870627099332864:12345-0@lo:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969523.080717:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1783969523.080734:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969523.080738:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969523.082311:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099333248:12345-0@lo:400:kworker.0 Request processed in 2050us (9891us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969523.082330:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783969523.082423:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099332480 00000100:00100000:3.0:1783969523.082433:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099332480 00000100:00100000:3.0:1783969523.082503:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969523.082513:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099332480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.083934:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870627099332352:0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.085103:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1870627099332864:0@lo:400:kworker.0 00010000:00080000:2.0:1783969523.085146:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983fc6680 x1870627099332992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969523.085156:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1870627099332992:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.086432:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099332480:12345-0@lo:400:kworker.0 Request processed in 3907us (6202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969523.086452:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783969523.087065:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099332480:0@lo:400:kworker.0 00000100:00100000:2.0:1783969523.087088:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969523.087107:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099333376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969523.087184:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969523.087404:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099331968 00000100:00100000:3.0:1783969523.087416:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099331968 00000100:00100000:3.0:1783969523.087490:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783969523.087502:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:3647:x1870627099331968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.089374:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:3647:x1870627099331968:12345-0@lo:400:kworker.0 Request processed in 1860us (9251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969523.089403:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783969523.089699:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099332224:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.089719:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea865ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099332736:0@lo:400:kworker.0 00010000:00080000:3.0:1783969523.089737:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983fc5880 x1870627099333248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969523.089748:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099333248:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.089760:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099332096:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.089772:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1783969523.089791:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099332608:0@lo:400:kworker.0 00000100:00100000:3.0:1783969523.089807:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099333120:0@lo:400:kworker.0 00000100:00100000:0.0:1783969523.090472:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099333376 00000100:00100000:0.0:1783969523.090487:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099333376 00000100:00100000:2.0:1783969523.090497:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099331968:0@lo:400:kworker.0 00000100:00100000:0.0:1783969523.090592:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783969523.090606:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099333376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969523.090641:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783969523.090725:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099333376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969523.090733:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969523.091226:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099333376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783969523.568704:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969523.568735:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099333504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783969523.568830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969523.568888:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099333504 00000100:00100000:2.0:1783969523.568897:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099333504 00000100:00100000:2.0:1783969523.568954:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969523.568963:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099333504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783969523.569006:0:17854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783969523.569056:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099333504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969523.569063:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969523.569132:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099333504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783969523.954172:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783969524.082761:0:17846:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 968cb78a-c1fe-4a90-8549-da4cc0f9624e 00000001:00100000:1.0:1783969524.082773:0:17846:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1a97a32d-150e-48b4-af23-95f3386e92f5 00000001:00100000:0.0:1783969524.092823:0:17092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 968cb78a-c1fe-4a90-8549-da4cc0f9624e 00000001:00100000:0.0:1783969524.092836:0:17092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1a97a32d-150e-48b4-af23-95f3386e92f5 00000001:00100000:3.0:1783969524.094144:0:18616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 968cb78a-c1fe-4a90-8549-da4cc0f9624e 00000001:00100000:3.0:1783969524.094153:0:18616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a97a32d-150e-48b4-af23-95f3386e92f5 00000040:00080000:0.0:1783969524.337130:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783969524.978551:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783969525.365133:0:19991:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783969526.004369:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969526.128838:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969526.128863:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099333632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969526.128946:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969526.129114:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099333632 00000100:00100000:1.0:1783969526.129121:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099333632 00000100:00100000:1.0:1783969526.129200:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783969526.129211:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099333632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969526.129241:0:19683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783969526.129295:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099333632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969526.129302:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783969526.129345:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099333632:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783969526.129516:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969526.552270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969526.552455:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969526.552492:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969526.552595:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074078336 00000100:00100000:1.0:1783969526.552607:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074078336 00000100:00100000:1.0:1783969526.552699:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1783969526.552711:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074078336:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969526.552932:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074078336:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 223us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969526.552941:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00080000:0.0:1783969526.553407:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969526.554680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969526.554725:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969526.554767:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969526.554813:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074078848 00000100:00100000:3.0:1783969526.554824:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074078848 00000100:00100000:3.0:1783969526.554899:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1783969526.554912:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074078848:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969526.555036:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074078848:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 127us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969526.555045:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1783969526.555761:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074078080 00000100:00100000:2.0:1783969526.555770:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074078080 00000100:00100000:2.0:1783969526.556089:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074078592 00000100:00100000:2.0:1783969526.556094:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074078592 00000100:00100000:2.0:1783969526.556163:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074078208 00000100:00100000:2.0:1783969526.556166:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074078208 00000100:00100000:2.0:1783969526.556243:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1783969526.556253:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2394:x1870627074078592:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969526.556315:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2394:x1870627074078592:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 63us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969526.556323:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1783969526.556340:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:2.0:1783969526.556346:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074078208:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969526.556367:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074078208:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969526.556373:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1783969526.556563:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969526.556602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969526.556688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969526.556711:0:18923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074078464 00000100:00100000:1.0:1783969526.556715:0:18923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074078464 00000100:00100000:1.0:1783969526.556743:0:18923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074078976 00000100:00100000:1.0:1783969526.556745:0:18923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074078976 00000100:00100000:3.0:1783969526.556847:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074078720 00000100:00100000:3.0:1783969526.556851:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074078720 00000100:00100000:3.0:1783969526.556874:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1783969526.556880:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074078720:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969526.556923:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074078720:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 42us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969526.556930:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1783969526.556952:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1783969526.557102:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074078464:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969526.557133:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074078464:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 36us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969526.557139:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1783969526.557314:0:18923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1783969526.557322:0:18923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2394:x1870627074078976:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969526.557352:0:18923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab779dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2394:x1870627074078976:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 31us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969526.557359:0:18923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1783969526.557557:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1783969526.557565:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2394:x1870627074078080:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969526.557600:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2394:x1870627074078080:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 35us (5346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969526.557606:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:1.0:1783969526.557880:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074077952 00000100:00100000:1.0:1783969526.557886:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074077952 00000100:00100000:1.0:1783969526.557918:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:1.0:1783969526.557925:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2394:x1870627074077952:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969526.558336:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2394:x1870627074077952:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 409us (3608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969526.558344:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00080000:1.0:1783969526.564243:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969526.564262:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783969526.564267:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969526.564270:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1783969526.651131:0:19435:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 968cb78a-c1fe-4a90-8549-da4cc0f9624e 00010000:00010000:3.0:1783969527.024928:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969527.165857:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099333760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969527.165969:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969527.166151:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099333760 00000100:00100000:2.0:1783969527.166161:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099333760 00000100:00080000:1.0:1783969527.166357:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969527.167352:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969527.167396:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099333760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783969527.167447:0:19683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783969527.167720:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099333760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 353us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969527.167731:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969527.167891:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099333760:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783969528.049986:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969528.176647:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969528.176692:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099333888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969528.176772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.177230:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099333888 00000100:00100000:1.0:1783969528.177244:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099333888 00000100:00100000:1.0:1783969528.177349:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783969528.177364:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099333888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969528.177424:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783969528.177505:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099333888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.177513:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1783969528.177600:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969528.177658:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099333888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969528.178408:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099334016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783969528.178456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969528.178497:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099334016 00000100:00100000:0.0:1783969528.178503:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099334016 00000100:00100000:0.0:1783969528.178643:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783969528.178653:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099334016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969528.178745:0:19683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783969528.178788:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099334016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969528.178795:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783969528.178814:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969528.178839:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099334016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969528.179357:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:451c11fa-8d33-493c-b495-458f5de7342a:3649:1870627099334272:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.179402:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.179424:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099334784:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.179443:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.179460:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099335296:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.179483:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.179502:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783969528.179506:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099334144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969528.179520:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.179530:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099334656:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.179541:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.179561:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099335168:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.179576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.179604:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099334272 00000100:00100000:1.0:1783969528.179607:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099334272 00000100:00100000:1.0:1783969528.179637:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783969528.179643:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:3649:x1870627099334272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969528.179648:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099334528:0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.179673:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099334400:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.180514:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:3649:x1870627099334272:12345-0@lo:400:kworker.0 Request processed in 868us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.180524:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783969528.180564:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099334784 00000100:00100000:1.0:1783969528.180569:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099334784 00000100:00100000:1.0:1783969528.180594:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099334144 00000100:00100000:1.0:1783969528.180597:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099334144 00000100:00100000:1.0:1783969528.180610:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783969528.180616:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1870627099334784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.180650:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1870627099334784:12345-0@lo:400:kworker.0 Request processed in 34us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.180656:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783969528.180667:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783969528.180672:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099334144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969528.180692:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783969528.180716:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099334144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.180721:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783969528.180738:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099335296 00000100:00100000:1.0:1783969528.180741:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099335296 00000100:00100000:1.0:1783969528.180770:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099334656 00000100:00100000:1.0:1783969528.180778:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099334656 00000100:00100000:1.0:1783969528.180793:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099335168 00000100:00100000:1.0:1783969528.180795:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099335168 00000100:00100000:1.0:1783969528.180810:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783969528.180815:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099335296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.180846:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1870627099335296:12345-0@lo:400:kworker.0 Request processed in 31us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.180852:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783969528.180863:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783969528.180869:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099334656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.180894:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099334656:12345-0@lo:400:kworker.0 Request processed in 25us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.180900:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783969528.180910:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783969528.180916:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099335168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.180941:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099335168:12345-0@lo:400:kworker.0 Request processed in 25us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.180946:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783969528.180991:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099334144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969528.181003:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099334656:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.181012:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099335168:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.181019:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:451c11fa-8d33-493c-b495-458f5de7342a:3649:1870627099334272:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.181025:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099334784:0@lo:400:kworker.0 00010000:00080000:1.0:1783969528.181049:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eab73e1500 x1870627099335296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969528.181064:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1870627099335296:0@lo:400:kworker.0 00000100:00080000:1.0:1783969528.182482:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969528.182489:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969528.184680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969528.184731:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099335040:0@lo:400:kworker.0 00000100:00100000:0.0:1783969528.184775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969528.184811:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099335040 00000100:00100000:0.0:1783969528.184819:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099335040 00000100:00100000:1.0:1783969528.184840:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099334528 00000100:00100000:1.0:1783969528.184846:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099334528 00000100:00100000:1.0:1783969528.184895:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783969528.184905:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099334528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.184956:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099334528:12345-0@lo:400:kworker.0 Request processed in 52us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.184963:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1783969528.184993:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969528.186072:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783969528.186085:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099335040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.187466:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099335552:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.190111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.190242:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099335552 00000100:00100000:1.0:1783969528.190250:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099335552 00000100:00100000:1.0:1783969528.190309:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783969528.190318:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099335552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.190373:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870627099335552:12345-0@lo:400:kworker.0 Request processed in 57us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.190395:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1783969528.190419:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783969528.190448:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eac1564000 x1870627099335552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969528.190462:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1870627099335552:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.190493:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099334528:0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.196172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969528.196261:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eab73e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099334912:0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.196349:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969528.196407:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099335424:0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.196442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969528.196519:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099334400 00000100:00100000:2.0:1783969528.196531:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099334400 00000100:00100000:0.0:1783969528.196617:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870627099335040:12345-0@lo:400:kworker.0 Request processed in 10526us (11832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969528.196633:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783969528.196676:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099335424 00000100:00100000:0.0:1783969528.196685:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099335424 00000100:00100000:0.0:1783969528.196748:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783969528.196758:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099335424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969528.196818:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870627099335424:12345-0@lo:400:kworker.0 Request processed in 63us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969528.196825:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1783969528.196866:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969528.196967:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870627099335040:0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.197053:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783969528.197065:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099334400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.197489:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099334400:12345-0@lo:400:kworker.0 Request processed in 425us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969528.197511:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783969528.197549:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099334912 00000100:00100000:2.0:1783969528.197556:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099334912 00000100:00100000:2.0:1783969528.197991:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783969528.198001:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099334912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.198070:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099334912:12345-0@lo:400:kworker.0 Request processed in 71us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969528.198077:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783969528.198420:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099334400:0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.198440:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eab73e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099334912:0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.198456:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1870627099335424:0@lo:400:kworker.0 00000040:00080000:2.0:1783969528.433621:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783969528.688617:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969528.690617:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099335680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969528.690694:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.690986:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099335680 00000100:00100000:3.0:1783969528.691001:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099335680 00000100:00100000:3.0:1783969528.691108:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783969528.691117:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099335680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969528.691152:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783969528.691244:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099335680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969528.691252:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783969528.691373:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099335680:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783969529.072903:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783969529.738364:0:20139:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0f060e50 20000000:00000080:0.0:1783969529.738408:0:20139:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ea86fec800 uarg=0000000000000000 20000000:01000000:0.0:1783969529.738448:0:20139:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783969529.738453:0:20139:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783969529.739571:0:20139:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783969529.740190:0:20140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1783969529.740333:0:20139:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783969529.751877:0:20139:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783969529.752631:0:20139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.752654:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbadff expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.752662:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbae0d expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.752669:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbae4c expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.752677:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbafb1 expref: 23 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.752687:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c14 expref: 12 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.752694:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c84 expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.752701:0:20139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.752768:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c84 expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.752786:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c84 expref: 12 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.752800:0:20139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1567800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099335808:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969529.753035:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c14 expref: 12 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.753044:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c14 expref: 12 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.753052:0:20139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1565c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099335936:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969529.753084:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbafb1 expref: 23 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.753163:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbafb1 expref: 23 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.753174:0:20139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1566300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099336064:0@lo:104: 00000100:00100000:1.0:1783969529.753219:0:20139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969529.753303:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbae4c expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.753312:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbae4c expref: 23 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.753333:0:20139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1564380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099336192:0@lo:104: 00000100:00100000:1.0:1783969529.753354:0:20139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969529.756642:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbae0d expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.756660:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbae0d expref: 23 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.756673:0:20139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1565500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099336320:0@lo:104: 00000100:00100000:1.0:1783969529.756727:0:20139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969529.760606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969529.760634:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969529.760676:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074079104 00000100:00100000:3.0:1783969529.760684:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074079104 00010000:00010000:3.0:1783969529.760720:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c84 expref: 13 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969529.760750:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074079232 00000100:00100000:3.0:1783969529.760752:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074079232 00010000:00010000:3.0:1783969529.760764:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c14 expref: 14 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969529.760778:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1783969529.760786:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+14:2392:x1870627074079104:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969529.760802:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969529.760808:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c84 expref: 14 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.760821:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c84 expref: 14 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.760842:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969529.760914:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+14:2392:x1870627074079104:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 128us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.760922:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1783969529.760939:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1783969529.760946:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2392:x1870627074079232:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969529.760954:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969529.760959:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c14 expref: 13 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.760969:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c14 expref: 13 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.760978:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969529.760996:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2392:x1870627074079232:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 50us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.761013:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1783969529.761445:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099336064 00000100:00100000:0.0:1783969529.761451:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099336064 00000100:00100000:0.0:1783969529.761494:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099336192 00000100:00100000:0.0:1783969529.761497:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099336192 00000100:00100000:0.0:1783969529.761512:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783969529.761519:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+4:20139:x1870627099336064:12345-0@lo:104: 00010000:00010000:0.0:1783969529.761538:0:17095:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761592:0:17095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969529.761597:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+4:20139:x1870627099336064:12345-0@lo:104: Request processed in 80us (8380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969529.761604:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783969529.761617:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783969529.761623:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1564700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+3:20139:x1870627099336192:12345-0@lo:104: 00010000:00010000:0.0:1783969529.761631:0:17095:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761664:0:17095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969529.761669:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1564700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+3:20139:x1870627099336192:12345-0@lo:104: Request processed in 47us (8314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969529.761674:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783969529.761700:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969529.761706:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761713:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bc600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969529.761717:0:17100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761725:0:17100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969529.761732:0:17100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969529.761737:0:17100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969529.761778:0:17100:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761785:0:17100:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969529.761806:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761813:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea837bc600/0xea31253a47cbafb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbafb8 expref: -99 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761825:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969529.761829:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761834:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:0.0:1783969529.761837:0:17100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761850:0:17100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969529.761857:0:17100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969529.761862:0:17100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969529.761875:0:17100:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.761881:0:17100:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969529.762570:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969529.762649:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.762660:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea91a52800/0xea31253a47cbae4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbae53 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.762672:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969529.762674:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969529.762675:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969529.762691:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:451c11fa-8d33-493c-b495-458f5de7342a:3649:1870627099336448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969529.762757:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969529.763118:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099336576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969529.763149:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969529.763195:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099336448 00000100:00100000:3.0:1783969529.763200:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099336448 00010000:00010000:3.0:1783969529.763226:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbafb1 expref: 24 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969529.763249:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099336576 00000100:00100000:3.0:1783969529.763252:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099336576 00010000:00010000:3.0:1783969529.763263:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbae4c expref: 25 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969529.763296:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969529.763304:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+25:3649:x1870627099336448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969529.763318:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969529.763324:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbafb1 expref: 25 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.763334:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbafb1 expref: 25 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.763355:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969529.763416:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+25:3649:x1870627099336448:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.763424:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969529.763439:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969529.763445:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+24:3646:x1870627099336576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969529.763453:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969529.763467:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbae4c expref: 24 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.763476:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbae4c expref: 24 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.763485:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969529.763508:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:451c11fa-8d33-493c-b495-458f5de7342a+24:3646:x1870627099336576:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.763515:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969529.763546:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099336576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969529.763574:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:451c11fa-8d33-493c-b495-458f5de7342a:3649:1870627099336448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969529.763757:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea31253a47cbadff expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.763768:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea31253a47cbadff expref: 23 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.763778:0:20139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1564e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099336704:0@lo:104: 00000100:00100000:1.0:1783969529.763804:0:20139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969529.763814:0:20139:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1783969529.763830:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea91a53a00/0xea31253a47cbb140 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c84 expref: 12 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.763842:0:20139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1567800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099335808:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969529.763852:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e983de7a00/0xea31253a47cbb101 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c14 expref: 11 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.763860:0:20139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1565c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099335936:192.168.201.34@tcp:104: 00010000:00010000:1.0:1783969529.763884:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea91a52000/0xea31253a47cbafb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbafb1 expref: 23 pid: 17106 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.763904:0:20139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1566300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099336064:0@lo:104: 00010000:00010000:1.0:1783969529.763914:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea91a53c00/0xea31253a47cbae53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbae4c expref: 22 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.763922:0:20139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1564380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099336192:0@lo:104: 00000100:00100000:3.0:1783969529.764567:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099336320 00000100:00100000:3.0:1783969529.764575:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099336320 00000100:00100000:3.0:1783969529.764600:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099336704 00000100:00100000:3.0:1783969529.764603:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099336704 00000100:00100000:3.0:1783969529.764616:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969529.764622:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+4:20139:x1870627099336320:12345-0@lo:104: 00010000:00010000:3.0:1783969529.764634:0:17095:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764689:0:17095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783969529.764695:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1566680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+4:20139:x1870627099336320:12345-0@lo:104: Request processed in 73us (7968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.764701:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969529.764713:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969529.764718:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+3:20139:x1870627099336704:12345-0@lo:104: 00010000:00010000:3.0:1783969529.764725:0:17095:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764753:0:17095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783969529.764758:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:451c11fa-8d33-493c-b495-458f5de7342a+3:20139:x1870627099336704:12345-0@lo:104: Request processed in 40us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.764763:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1783969529.764776:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969529.764781:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764788:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de6000 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969529.764798:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764807:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969529.764814:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969529.764820:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969529.764844:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764849:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969529.764862:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764869:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93e983de6000/0xea31253a47cbae0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbae14 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764879:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969529.764882:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764899:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea83daf600 already unused, calling callback (ffffffffc131dc20) 10000000:00010000:3.0:1783969529.764902:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764909:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969529.764924:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969529.764930:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969529.764941:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764945:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969529.764958:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764965:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff93ea83daf600/0xea31253a47cbadff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea31253a47cbae06 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.764977:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969529.764979:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969529.764980:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969529.764990:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099336832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969529.765029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969529.765059:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099336960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969529.765078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969529.765097:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099336832 00000100:00100000:3.0:1783969529.765100:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099336832 00010000:00010000:3.0:1783969529.765114:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbae0d expref: 22 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969529.765125:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099336960 00000100:00100000:3.0:1783969529.765127:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099336960 00010000:00010000:3.0:1783969529.765140:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbadff expref: 23 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969529.765151:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969529.765156:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+23:3647:x1870627099336832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969529.765164:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969529.765168:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbae0d expref: 23 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765176:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbae0d expref: 23 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765188:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969529.765210:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84eb6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+23:3647:x1870627099336832:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.765215:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969529.765244:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969529.765249:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+22:3648:x1870627099336960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969529.765256:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969529.765260:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea31253a47cbadff expref: 22 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765268:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea31253a47cbadff expref: 22 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765280:0:17098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765288:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765310:0:17098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765317:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765324:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765330:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765335:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de7800 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969529.765339:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765346:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765353:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.765361:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969529.765407:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:451c11fa-8d33-493c-b495-458f5de7342a+22:3648:x1870627099336960:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.765413:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969529.765440:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099336960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969529.766543:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:451c11fa-8d33-493c-b495-458f5de7342a:3647:1870627099336832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969529.766581:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969529.766708:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e983de6200/0xea31253a47cbae14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbae0d expref: 21 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.766722:0:20139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1565500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099336320:0@lo:104: 00010000:00010000:1.0:1783969529.766732:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ea89cde400/0xea31253a47cbae06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea31253a47cbadff expref: 20 pid: 17105 timeout: 691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969529.766740:0:20139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1564e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1870627099336704:0@lo:104: 00010000:00010000:1.0:1783969529.766769:0:20139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.766778:0:20139:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.766785:0:20139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969529.766790:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93e983de7800/0xea31253a47cbb171 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969530.096551:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969530.827294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969530.827587:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074079360 00000100:00100000:0.0:1783969530.827601:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074079360 00000100:00100000:0.0:1783969530.827695:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00100000:0.0:1783969530.827709:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+11:14913:x1870627074079360:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969530.827732:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969530.827758:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983ddd200/0xea31253a47cbb178 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303cbc expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969530.827820:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983ddd200/0xea31253a47cbb178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cbc expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969530.827833:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983ddd200/0xea31253a47cbb178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cbc expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969530.827844:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddd200, rc 0) 00000100:00100000:0.0:1783969530.827925:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:14913:x1870627074079360:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 219us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969530.827933:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00100000:3.0:1783969530.830755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969530.830881:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074079488 00000100:00100000:0.0:1783969530.830893:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074079488 00000100:00100000:0.0:1783969530.830993:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:0.0:1783969530.831007:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:14913:x1870627074079488:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969530.831477:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:14913:x1870627074079488:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 470us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969530.831488:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:3.0:1783969530.833676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969530.833783:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074079616 00000100:00100000:0.0:1783969530.833796:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074079616 00000100:00100000:0.0:1783969530.834234:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:0.0:1783969530.834250:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:14913:x1870627074079616:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969530.834484:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:14913:x1870627074079616:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 238us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969530.834492:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:0.0:1783969530.851420:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969530.851492:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074079744 00000100:00100000:0.0:1783969530.851505:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074079744 00000100:00100000:0.0:1783969530.851591:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 155 00000100:00100000:0.0:1783969530.851604:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+12:14913:x1870627074079744:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969530.851625:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969530.851650:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93e983dddc00/0xea31253a47cbb17f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x129fb3d356303cc3 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969530.851687:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93e983dddc00/0xea31253a47cbb17f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cc3 expref: 13 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969530.851701:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93e983dddc00/0xea31253a47cbb17f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cc3 expref: 13 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969530.851712:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983dddc00, rc 0) 00000100:00100000:0.0:1783969530.851789:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:14913:x1870627074079744:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 188us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969530.851797:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 155 00000100:00100000:1.0:1783969530.857351:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969530.857863:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074079872 00000100:00100000:0.0:1783969530.857877:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074079872 00000100:00100000:0.0:1783969530.857968:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 156 00000100:00100000:0.0:1783969530.857981:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:14913:x1870627074079872:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969530.858206:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:14913:x1870627074079872:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 227us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969530.858217:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 156 00000100:00100000:1.0:1783969530.863346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969530.863488:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074080000 00000100:00100000:3.0:1783969530.863503:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074080000 00000100:00100000:3.0:1783969530.863571:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 157 00000100:00100000:3.0:1783969530.863584:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:14913:x1870627074080000:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969530.863780:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:14913:x1870627074080000:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 198us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969530.863790:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 157 00010000:00010000:3.0:1783969531.121526:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969531.248753:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969531.248790:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099337088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969531.248888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969531.248993:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099337088 00000100:00100000:0.0:1783969531.249004:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099337088 00000100:00100000:0.0:1783969531.249120:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783969531.249140:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099337088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969531.249179:0:19683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783969531.249241:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099337088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969531.249249:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783969531.249325:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099337088:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783969531.249545:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1783969531.634307:0:17109:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969531.634318:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eab9fc1800 from 13 10000000:01000000:3.0:1783969531.634325:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969531.634424:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a53400/0xea31253a47cbb186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969531.634439:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a53400/0xea31253a47cbb186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969531.634453:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a53400/0xea31253a47cbb186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969531.634488:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969531.634584:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969531.634647:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab9105000 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.634739:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099337216 00000100:00100000:2.0:1783969531.634748:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099337216 00000100:00100000:2.0:1783969531.634807:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783969531.634819:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+20:17109:x1870627099337216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969531.634836:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969531.634854:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea837bd600/0xea31253a47cbb18d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbb186 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.634885:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea837bd600/0xea31253a47cbb18d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbb186 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.634898:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea837bd600/0xea31253a47cbb18d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbb186 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.634933:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bd600, rc 0) 00000100:00100000:2.0:1783969531.634997:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+21:17109:x1870627099337216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.635005:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783969531.635074:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969531.635092:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a53400/0xea31253a47cbb186 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb18d expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.635102:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a53400/0xea31253a47cbb186 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbb18d expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969531.635180:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.635206:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969531.635229:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94488cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.635243:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099337344 00000100:00100000:2.0:1783969531.635246:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099337344 00000100:00100000:2.0:1783969531.635270:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783969531.635276:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea867ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:17109:x1870627099337344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.635451:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea867ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:17109:x1870627099337344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.635458:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783969531.635490:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.635540:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.635604:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969531.635631:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea94488cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.635642:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099337472 00000100:00100000:2.0:1783969531.635646:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099337472 00000100:00100000:2.0:1783969531.635679:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783969531.635686:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:17109:x1870627099337472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.635769:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:17109:x1870627099337472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.635777:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783969531.635815:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783969531.636550:0:20207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783969531.636628:0:17109:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783969531.636648:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969531.636660:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a53400/0xea31253a47cbb186 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb18d expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.636670:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a53400/0xea31253a47cbb186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb18d expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969531.636681:0:17109:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783969531.636684:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93eaa01ec800 from 13 10000000:01000000:2.0:1783969531.636687:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969531.636723:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea837bc200/0xea31253a47cbb194 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.636731:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea837bc200/0xea31253a47cbb194 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.636741:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea837bc200/0xea31253a47cbb194 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969531.636776:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.636827:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969531.636858:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9860db40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.636877:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099337600 00000100:00100000:2.0:1783969531.636883:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099337600 00000100:00100000:2.0:1783969531.636918:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783969531.636927:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+21:17109:x1870627099337600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969531.636943:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969531.636956:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea837bdc00/0xea31253a47cbb19b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbb194 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.636995:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea837bdc00/0xea31253a47cbb19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbb194 expref: 22 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.637006:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea837bdc00/0xea31253a47cbb19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbb194 expref: 22 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.637016:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bdc00, rc 0) 00000100:00100000:2.0:1783969531.637047:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:17109:x1870627099337600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.637054:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783969531.637098:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969531.637110:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea837bc200/0xea31253a47cbb194 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb19b expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.637119:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea837bc200/0xea31253a47cbb194 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbb19b expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969531.637180:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.637208:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969531.637222:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9860db40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.637232:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099337728 00000100:00100000:2.0:1783969531.637235:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099337728 00000100:00100000:2.0:1783969531.637255:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783969531.637261:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:17109:x1870627099337728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.637366:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:17109:x1870627099337728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.637374:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783969531.637443:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.637469:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.637511:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969531.637528:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea9860db40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.637538:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099337856 00000100:00100000:2.0:1783969531.637541:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099337856 00000100:00100000:2.0:1783969531.637562:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783969531.637568:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:17109:x1870627099337856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.637643:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:17109:x1870627099337856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.637650:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783969531.637689:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783969531.639874:0:20208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783969531.643304:0:17109:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783969531.643362:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969531.643504:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea837bc200/0xea31253a47cbb194 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb19b expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969531.643519:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea837bc200/0xea31253a47cbb194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb19b expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969531.643532:0:17109:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969531.643536:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e9835eb000 from 13 10000000:01000000:3.0:1783969531.643539:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969531.643595:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52200/0xea31253a47cbb1a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969531.643604:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93ea91a52200/0xea31253a47cbb1a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969531.643617:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93ea91a52200/0xea31253a47cbb1a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969531.643653:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969531.643752:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969531.643850:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab9105d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.647337:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099337984 00000100:00100000:2.0:1783969531.647409:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099337984 00000100:00100000:2.0:1783969531.647492:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783969531.647504:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+22:17109:x1870627099337984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969531.647525:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969531.647549:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea837bce00/0xea31253a47cbb1a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbb1a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.647589:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea837bce00/0xea31253a47cbb1a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbb1a2 expref: 23 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.647603:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea837bce00/0xea31253a47cbb1a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbb1a2 expref: 23 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.647613:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bce00, rc 0) 00000100:00100000:2.0:1783969531.647715:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099337984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (3963us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.647722:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783969531.647928:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099337984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969531.647951:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93ea91a52200/0xea31253a47cbb1a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb1a9 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969531.647962:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93ea91a52200/0xea31253a47cbb1a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbb1a9 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969531.648090:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969531.648131:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969531.648172:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea913530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.648270:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099338112 00000100:00100000:2.0:1783969531.648275:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099338112 00000100:00100000:2.0:1783969531.648311:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783969531.648320:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98360c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099338112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.648771:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98360c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099338112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.648780:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783969531.648818:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.648853:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.648899:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969531.648926:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea812ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.648937:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099338240 00000100:00100000:2.0:1783969531.648941:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099338240 00000100:00100000:2.0:1783969531.648959:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783969531.648965:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099338240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969531.649186:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099338240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.649193:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783969531.649234:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e9837c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783969531.653864:0:20209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783969531.654294:0:17109:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783969531.654336:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969531.654353:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93ea91a52200/0xea31253a47cbb1a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb1a9 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969531.654370:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93ea91a52200/0xea31253a47cbb1a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb1a9 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969531.654406:0:17109:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783969531.654432:0:17109:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff93e98330a000 from 13 10000000:01000000:0.0:1783969531.654436:0:17109:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969531.654490:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983ddd000/0xea31253a47cbb1b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969531.654499:0:17109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff93e983ddd000/0xea31253a47cbb1b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969531.654511:0:17109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff93e983ddd000/0xea31253a47cbb1b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969531.654549:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969531.654650:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969531.654715:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea91353300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969531.654889:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099338368 00000100:00100000:2.0:1783969531.654897:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099338368 00000100:00100000:2.0:1783969531.654967:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783969531.654988:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+23:17109:x1870627099338368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969531.655007:0:17106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969531.655023:0:17106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ea837bd200/0xea31253a47cbb1b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea31253a47cbb1b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.655052:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ea837bd200/0xea31253a47cbb1b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea31253a47cbb1b0 expref: 24 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.655200:0:17106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ea837bd200/0xea31253a47cbb1b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea31253a47cbb1b0 expref: 24 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969531.655212:0:17106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bd200, rc 0) 00000100:00100000:2.0:1783969531.655275:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:451c11fa-8d33-493c-b495-458f5de7342a+24:17109:x1870627099338368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 290us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.655283:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783969531.655418:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969531.655436:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff93e983ddd000/0xea31253a47cbb1b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb1b7 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969531.655446:0:17109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff93e983ddd000/0xea31253a47cbb1b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea31253a47cbb1b7 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969531.655520:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969531.655553:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969531.655635:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea91353300 going to sleep for 11 seconds 00000100:00100000:3.0:1783969531.656805:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099338496 00000100:00100000:3.0:1783969531.656815:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099338496 00000100:00100000:3.0:1783969531.656866:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783969531.656876:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:17109:x1870627099338496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969531.658991:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:17109:x1870627099338496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2091us (3411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969531.659012:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783969531.667538:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969531.667582:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969531.667610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969531.667632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969531.667663:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969531.667696:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969531.667716:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969531.667738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969531.667784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969531.667823:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074080512 00000100:00100000:2.0:1783969531.667835:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074080512 00000100:00100000:2.0:1783969531.667905:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074081024 00000100:00100000:2.0:1783969531.667907:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074081024 00000100:00100000:2.0:1783969531.667920:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074080640 00000100:00100000:2.0:1783969531.667922:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074080640 00000100:00100000:2.0:1783969531.667934:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074081152 00000100:00100000:2.0:1783969531.667936:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074081152 00000100:00100000:2.0:1783969531.667954:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1783969531.667965:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2391:x1870627074080512:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969531.668163:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074080256 00000100:00100000:3.0:1783969531.668181:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074080256 00000100:00100000:3.0:1783969531.668209:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074080768 00000100:00100000:3.0:1783969531.668211:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074080768 00000100:00100000:3.0:1783969531.668226:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074080384 00000100:00100000:3.0:1783969531.668228:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074080384 00000100:00100000:3.0:1783969531.668243:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074080896 00000100:00100000:3.0:1783969531.668245:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074080896 00000100:00100000:3.0:1783969531.668262:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:3.0:1783969531.668269:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2391:x1870627074080256:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969531.671087:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2391:x1870627074080512:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 3105us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.671106:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1783969531.671158:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1783969531.671176:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2391:x1870627074081024:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969531.671342:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969531.676149:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2391:x1870627074080256:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 7862us (8609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969531.676172:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:3.0:1783969531.676228:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1783969531.676246:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2391:x1870627074080768:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969531.676318:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2391:x1870627074080768:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 80us (8706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969531.676325:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1783969531.676339:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:3.0:1783969531.676346:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2391:x1870627074080384:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969531.683223:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2391:x1870627074080384:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (8681us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969531.683260:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:3.0:1783969531.683326:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:3.0:1783969531.683351:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2391:x1870627074080896:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969531.683480:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2391:x1870627074080896:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 144us (15740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969531.683507:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:2.0:1783969531.683660:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2391:x1870627074081024:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 12489us (16022us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.683681:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1783969531.683715:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1783969531.683726:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e9837c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2391:x1870627074080640:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969531.683757:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e9837c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2391:x1870627074080640:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 35us (16039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.683763:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1783969531.683774:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1783969531.683781:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2391:x1870627074081152:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969531.683804:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2391:x1870627074081152:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 23us (16021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.683810:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00080000:2.0:1783969531.683866:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783969531.683872:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969531.683876:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969531.683879:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969531.684109:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074080128 00000100:00100000:2.0:1783969531.684119:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074080128 00000100:00100000:2.0:1783969531.684174:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:2.0:1783969531.684181:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2391:x1870627074080128:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969531.684221:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2391:x1870627074080128:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 41us (16557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969531.684228:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:1.0:1783969531.685546:0:17109:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1565500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969531.685652:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969531.685711:0:17109:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e8d7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969531.688107:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099338624 00000100:00100000:3.0:1783969531.688129:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099338624 00000100:00100000:3.0:1783969531.688213:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783969531.688225:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:17109:x1870627099338624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969531.688469:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:17109:x1870627099338624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969531.688478:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783969531.688562:0:17109:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1565500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:451c11fa-8d33-493c-b495-458f5de7342a:17109:1870627099338624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783969531.691354:0:20210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783969531.691802:0:17109:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783969531.691845:0:17109:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969531.691860:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff93e983ddd000/0xea31253a47cbb1b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb1b7 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969531.691887:0:17109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff93e983ddd000/0xea31253a47cbb1b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea31253a47cbb1b7 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969532.155287:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969532.273577:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969532.285329:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099338752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969532.285462:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969532.286277:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099338752 00000100:00100000:3.0:1783969532.286292:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099338752 00000100:00100000:3.0:1783969532.286406:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969532.286420:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099338752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969532.286456:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783969532.286536:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099338752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969532.286544:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1783969532.286691:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969532.286744:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099338752:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783969533.169476:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969533.296666:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969533.296693:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099338880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969533.296764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969533.296902:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099338880 00000100:00100000:0.0:1783969533.296911:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099338880 00000100:00100000:0.0:1783969533.296982:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783969533.296998:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099338880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783969533.297028:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1783969533.297123:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969533.297217:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099338880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 226us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969533.297225:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783969533.297304:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099338880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969533.297662:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969533.297674:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099339008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969533.297706:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969533.297993:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099339392:0@lo:400:kworker.0 00000100:00100000:2.0:1783969533.298022:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969533.298132:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099339264:0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.298203:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099339520:0@lo:400:kworker.0 00000100:00100000:1.0:1783969533.298257:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099339136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783969533.300268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969533.300330:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099339776:0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.300370:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969533.302614:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099340288:0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.302685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969533.302762:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099339392 00000100:00100000:3.0:1783969533.302770:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099339392 00000100:00100000:3.0:1783969533.302815:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099339776 00000100:00100000:3.0:1783969533.302819:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099339776 00000100:00100000:3.0:1783969533.302834:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783969533.302841:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac157a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099339392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.302894:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac157a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870627099339392:12345-0@lo:400:kworker.0 Request processed in 53us (4871us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969533.302900:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783969533.302916:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783969533.302921:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099339776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.302965:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099339776:12345-0@lo:400:kworker.0 Request processed in 43us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969533.302971:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783969533.302988:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099340288 00000100:00100000:3.0:1783969533.302992:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099340288 00000100:00100000:3.0:1783969533.303249:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969533.303257:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099340288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.303291:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099340288:12345-0@lo:400:kworker.0 Request processed in 36us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969533.303297:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1783969533.303331:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969533.303363:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099339776:0@lo:400:kworker.0 00010000:00080000:3.0:1783969533.303397:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eac1578a80 x1870627099340288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969533.303422:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099340288:0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.303473:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099339264 00000100:00100000:3.0:1783969533.303478:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099339264 00000100:00100000:3.0:1783969533.303503:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783969533.303508:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:3646:x1870627099339264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.303543:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:451c11fa-8d33-493c-b495-458f5de7342a+24:3646:x1870627099339264:12345-0@lo:400:kworker.0 Request processed in 34us (3281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969533.303549:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783969533.303582:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:451c11fa-8d33-493c-b495-458f5de7342a:3646:1870627099339264:0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.303619:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099339008 00000100:00100000:3.0:1783969533.303622:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099339008 00000100:00100000:3.0:1783969533.303652:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969533.303658:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099339008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969533.303673:0:19683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783969533.303704:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099339008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969533.303710:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1783969533.303727:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969533.306108:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969533.306158:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099340032:0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.306203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969533.306227:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099340544:0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.306253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969533.306320:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099340032 00000100:00100000:0.0:1783969533.306328:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099340032 00000100:00100000:0.0:1783969533.306374:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099340544 00000100:00100000:0.0:1783969533.306377:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099340544 00000100:00100000:0.0:1783969533.306446:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783969533.306455:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099340032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.306508:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870627099340032:12345-0@lo:400:kworker.0 Request processed in 54us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969533.306527:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783969533.306543:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783969533.306550:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099340544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.306581:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870627099340544:12345-0@lo:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969533.306586:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1783969533.306605:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969533.306633:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870627099340032:0@lo:400:kworker.0 00010000:00080000:0.0:1783969533.306645:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93eac1579c00 x1870627099340544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969533.306655:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1870627099340544:0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.309777:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099339520 00000100:00100000:3.0:1783969533.309792:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099339520 00000100:00100000:3.0:1783969533.309874:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969533.309887:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099339520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.309998:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099339520:12345-0@lo:400:kworker.0 Request processed in 116us (3897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969533.310005:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1783969533.311558:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969533.311615:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099339520:0@lo:400:kworker.0 00000100:00100000:1.0:1783969533.313005:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969533.313064:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099339648:0@lo:400:kworker.0 00000100:00100000:1.0:1783969533.313105:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969533.313132:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac157ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099340160:0@lo:400:kworker.0 00000100:00100000:1.0:1783969533.313156:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969533.313200:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099339008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969533.313239:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099339648 00000100:00100000:1.0:1783969533.313244:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099339648 00000100:00100000:1.0:1783969533.313301:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099340160 00000100:00100000:1.0:1783969533.313304:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099340160 00000100:00100000:1.0:1783969533.313335:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783969533.313343:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099339648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.313592:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783969533.313608:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099340160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.313647:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1870627099340160:12345-0@lo:400:kworker.0 Request processed in 47us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969533.313654:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1783969533.313694:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969533.313729:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1870627099339648:0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.313740:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac157ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1870627099340160:0@lo:400:kworker.0 00000100:00100000:1.0:1783969533.313799:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1870627099339648:12345-0@lo:400:kworker.0 Request processed in 456us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969533.313806:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783969533.315065:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099339136 00000100:00100000:3.0:1783969533.315076:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099339136 00000100:00100000:3.0:1783969533.315133:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783969533.315143:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099339136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783969533.315174:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783969533.315246:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099339136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969533.315253:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783969533.315558:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099339136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783969533.315887:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1870627099339392:0@lo:400:kworker.0 00000100:00100000:2.0:1783969533.315913:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099339904:0@lo:400:kworker.0 00000100:00100000:2.0:1783969533.315967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969533.316043:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac157b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099340416:0@lo:400:kworker.0 00000100:00100000:2.0:1783969533.316072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969533.316257:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099340416 00000100:00100000:3.0:1783969533.316262:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099340416 00000100:00100000:3.0:1783969533.316316:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783969533.316324:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099340416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969533.316364:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870627099340416:12345-0@lo:400:kworker.0 Request processed in 41us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969533.316369:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1783969533.316523:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969533.317551:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac157b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1870627099340416:0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.323258:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099339904 00000100:00100000:0.0:1783969533.323275:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099339904 00000100:00100000:0.0:1783969533.323462:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783969533.323474:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac157aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099339904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969533.323581:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac157aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870627099339904:12345-0@lo:400:kworker.0 Request processed in 110us (7613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969533.323588:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783969533.323684:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1870627099339904:0@lo:400:kworker.0 00000100:00100000:1.0:1783969533.809208:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac157b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099340672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969533.809286:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969533.809406:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099340672 00000100:00100000:3.0:1783969533.809414:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099340672 00000100:00100000:3.0:1783969533.809474:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783969533.809485:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099340672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783969533.809527:0:17854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783969533.809585:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099340672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969533.809610:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783969533.809756:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac157b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099340672:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783969534.193251:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783969534.583971:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783969534.601918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969534.602054:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074081280 00000100:00100000:0.0:1783969534.602065:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074081280 00000100:00100000:0.0:1783969534.602160:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:0.0:1783969534.602178:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+6:15581:x1870627074081280:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969534.602200:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969534.602222:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb1be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303cca expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602288:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602304:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602317:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602332:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602339:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602346:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783969534.602483:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783969534.602488:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc600/0xea31253a47cbb1d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602497:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc600/0xea31253a47cbb1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602504:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc600/0xea31253a47cbb1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969534.602543:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783969534.602548:0:17114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969534.602578:0:17114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc600/0xea31253a47cbb1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602588:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602594:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602599:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602605:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddcc00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969534.602608:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602615:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602627:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea829f4700) 00010000:00010000:0.0:1783969534.602636:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969534.602640:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602647:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb1c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602660:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602665:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602670:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602675:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddc400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969534.602677:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602683:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602690:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93ea83c43600) 00010000:00010000:0.0:1783969534.602693:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969534.602695:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602700:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb1cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602740:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb1be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cca expref: 8 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602766:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc600/0xea31253a47cbb1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cca expref: 7 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.602774:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ea83c43f00) 00010000:00010000:0.0:1783969534.602776:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969534.602778:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddc600, rc 0) 00000100:00100000:0.0:1783969534.602846:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+7:15581:x1870627074081280:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 677us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969534.602854:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1783969534.611317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969534.611407:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074081408 00000100:00100000:0.0:1783969534.611418:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074081408 00000100:00100000:0.0:1783969534.611491:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1783969534.611502:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a97a32d-150e-48b4-af23-95f3386e92f5+7:15581:x1870627074081408:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783969534.611593:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a97a32d-150e-48b4-af23-95f3386e92f5+7:15581:x1870627074081408:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969534.611600:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:1.0:1783969534.614782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969534.614866:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074081664 00000100:00100000:3.0:1783969534.614877:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074081664 00000100:00100000:3.0:1783969534.614946:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1783969534.614957:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+7:15581:x1870627074081664:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969534.614979:0:19100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969534.615001:0:19100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb1da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303cd1 expref: -99 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.615104:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.615119:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.615132:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.615148:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.615155:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.615160:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.615289:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cbb1ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.615316:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cbb1ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.615323:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cbb1ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969534.615332:0:19100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1783969534.616171:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616183:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616189:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616195:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969534.616199:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616206:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616221:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ea83c43f00) 00010000:00010000:3.0:1783969534.616225:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969534.616228:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616235:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb1e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616249:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616264:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616269:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616275:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969534.616278:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616284:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616292:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93eab9b3cb00) 00010000:00010000:3.0:1783969534.616295:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969534.616297:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.616303:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb1e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.617346:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb1da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cd1 expref: 10 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.617367:0:19100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52000/0xea31253a47cbb1ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cd1 expref: 9 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.617374:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93eab9b3c400) 00010000:00010000:3.0:1783969534.617376:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969534.617413:0:19100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52000, rc 0) 00000100:00100000:3.0:1783969534.617609:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+9:15581:x1870627074081664:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2651us (2835us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783969534.617619:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1783969534.627956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969534.628066:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074081792 00000100:00100000:0.0:1783969534.628076:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074081792 00000100:00100000:0.0:1783969534.628151:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1783969534.628163:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+9:15581:x1870627074081792:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783969534.628274:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+9:15581:x1870627074081792:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 113us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969534.628282:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:1.0:1783969534.644110:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969534.644336:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074081920 00000100:00100000:2.0:1783969534.644345:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074081920 00000100:00100000:2.0:1783969534.644461:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1783969534.644474:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+5:15581:x1870627074081920:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1783969534.645450:0:17112:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 931us 00000100:00080000:1.0:1783969534.648306:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783969534.691467:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+5:15581:x1870627074081920:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 46972us (47343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969534.691488:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:1.0:1783969534.701496:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969534.702410:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074082048 00000100:00100000:3.0:1783969534.702421:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074082048 00000100:00100000:3.0:1783969534.702492:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1783969534.702502:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+9:15587:x1870627074082048:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969534.702523:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969534.702542:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb1fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303cd8 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702599:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702614:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702625:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702640:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702646:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702652:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702717:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702725:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702731:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702737:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969534.702741:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702749:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702761:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea829f4700) 00010000:00010000:3.0:1783969534.702763:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969534.702768:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702775:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702787:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702792:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702798:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702810:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969534.702812:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702818:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702826:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93eab9b3cb00) 00010000:00010000:3.0:1783969534.702828:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969534.702831:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702837:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb20b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702868:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb1fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cd8 expref: 10 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702880:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea829f4700) 00010000:00010000:3.0:1783969534.702881:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969534.702885:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb1fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cd8 expref: 10 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.702894:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52e00, rc 0) 00000100:00100000:3.0:1783969534.702991:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+9:15587:x1870627074082048:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 489us (1504us total) trans 0 rc 301/301 00000100:00100000:3.0:1783969534.702998:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1783969534.715425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969534.715582:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074082176 00000100:00100000:0.0:1783969534.715593:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074082176 00000100:00100000:0.0:1783969534.715650:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1783969534.715662:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a97a32d-150e-48b4-af23-95f3386e92f5+9:15587:x1870627074082176:12345-192.168.201.34@tcp:700:lfs.0 00000100:00100000:0.0:1783969534.715744:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a97a32d-150e-48b4-af23-95f3386e92f5+9:15587:x1870627074082176:12345-192.168.201.34@tcp:700:lfs.0 Request processed in 85us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969534.715752:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1783969534.721691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969534.721770:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074082432 00000100:00100000:3.0:1783969534.721780:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074082432 00000100:00100000:3.0:1783969534.721844:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1783969534.721854:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+9:15587:x1870627074082432:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:3.0:1783969534.721912:0:19100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969534.721950:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb12b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303c45 expref: 9 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.721970:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea829f4700) 00010000:00010000:3.0:1783969534.721976:0:19100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969534.722035:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.722048:0:19100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cb5 expref: 5 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.722055:0:19100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.722098:0:19100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cb5 expref: 5 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.722111:0:19100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cb5 expref: 5 pid: 17112 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969534.722125:0:19100:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19100:1870627099340800:192.168.201.34@tcp:104: 00000100:00100000:3.0:1783969534.722211:0:19100:0:(client.c:2702:ptlrpc_set_wait()) set ffff93eab9105780 going to sleep for 11 seconds 00000100:00100000:1.0:1783969534.728521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969534.728795:0:19100:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19100:1870627099340800:192.168.201.34@tcp:104: 00010000:00010000:3.0:1783969534.728836:0:19100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969534.728908:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074082560 00000100:00100000:2.0:1783969534.728915:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074082560 00010000:00010000:2.0:1783969534.728980:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cb5 expref: 6 pid: 17112 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969534.729009:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1783969534.729018:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:2392:x1870627074082560:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969534.729032:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969534.729039:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cb5 expref: 6 pid: 17112 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.729052:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cb5 expref: 6 pid: 17112 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.729098:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb16a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cb5 expref: 6 pid: 17112 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.729115:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea829f4700) 00010000:00010000:2.0:1783969534.729120:0:17098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.729129:0:17098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.729137:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.729167:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969534.729221:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2392:x1870627074082560:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 203us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969534.729229:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:3.0:1783969534.729346:0:19100:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.729354:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.729376:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.729420:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.729428:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783969534.729871:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969534.731722:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731743:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731753:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969534.731791:0:19100:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae9594c8 reply state 00000000edf39047 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731802:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731823:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:3.0:1783969534.731826:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969534.731830:0:19100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783969534.731836:0:19100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783969534.731845:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731852:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731859:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731865:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969534.731870:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731877:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731887:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ea829f4700) 00010000:00010000:3.0:1783969534.731890:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969534.731893:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731899:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb212 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969534.731929:0:19100:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae9594c8 reply state 00000000edf39047 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731950:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.731956:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93eab9b3cb00) 00010000:00010000:3.0:1783969534.731958:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969534.731960:0:19100:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783969534.732207:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+10:15587:x1870627074082432:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 10349us (10521us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783969534.732216:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:1.0:1783969534.851248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969534.851968:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074082688 00000100:00100000:3.0:1783969534.851987:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074082688 00000100:00100000:3.0:1783969534.852089:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:3.0:1783969534.852104:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+10:15595:x1870627074082688:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:3.0:1783969534.852140:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969534.852182:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb227 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303cdf expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.852291:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cbb22e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.852314:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cbb22e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.852334:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cbb22e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969534.852480:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783969534.852488:0:17114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783969534.852568:0:17114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cbb22e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.852609:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cdf expref: 12 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.852640:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53a00/0xea31253a47cbb22e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cdf expref: 11 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.852652:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93eab9b3c700) 00010000:00010000:3.0:1783969534.852656:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969534.852661:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a53a00, rc 0) 00000100:00100000:3.0:1783969534.852758:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+11:15595:x1870627074082688:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 657us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969534.852767:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:1.0:1783969534.914424:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969534.914549:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074082816 00000100:00100000:0.0:1783969534.914566:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074082816 00000100:00100000:0.0:1783969534.914661:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:0.0:1783969534.914673:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:15596:x1870627074082816:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969534.914694:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969534.914716:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb235 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303ce6 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.914903:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb23c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.914931:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb23c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.914945:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb23c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969534.914991:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783969534.914995:0:17112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969534.915033:0:17112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb23c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.915059:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb235 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ce6 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.915078:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc400/0xea31253a47cbb23c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ce6 expref: 6 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.915161:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93eab9b3c700) 00010000:00010000:0.0:1783969534.915164:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969534.915169:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddc400, rc 0) 00000100:00100000:0.0:1783969534.915250:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15596:x1870627074082816:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 580us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969534.915257:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:1.0:1783969534.932905:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969534.933188:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074082944 00000100:00100000:2.0:1783969534.933201:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074082944 00000100:00100000:2.0:1783969534.933287:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1783969534.933300:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+6:15596:x1870627074082944:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969534.933327:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969534.933354:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303ced expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933481:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933524:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933538:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933552:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933560:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933567:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933683:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb258 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933693:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933701:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969534.933760:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783969534.933765:0:17113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969534.933795:0:17113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb258 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933813:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933833:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933840:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933847:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bd000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969534.933852:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933861:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933877:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93eab9b3c700) 00010000:00010000:2.0:1783969534.933880:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969534.933886:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933893:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb24a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.933909:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.934294:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.934309:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.934316:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bde00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969534.934335:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.934345:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.934359:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93eab9b3cb00) 00010000:00010000:2.0:1783969534.934364:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969534.934368:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.934375:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb251 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.934494:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ced expref: 8 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.934511:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb258 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ced expref: 7 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.934519:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:2.0:1783969534.934521:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969534.934523:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bc000, rc 0) 00000100:00100000:2.0:1783969534.934639:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+7:15596:x1870627074082944:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1339us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969534.934650:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:1.0:1783969534.943233:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969534.945946:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074083072 00000100:00100000:0.0:1783969534.945966:0:17123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074083072 00000100:00100000:1.0:1783969534.951266:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1783969534.951291:0:17123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:15596:x1870627074083072:12345-192.168.201.34@tcp:900:lfs.0 00000100:00080000:0.0:1783969534.951555:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783969534.952338:0:17123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:15596:x1870627074083072:12345-192.168.201.34@tcp:900:lfs.0 Request processed in 1046us (9113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969534.952354:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1783969534.956718:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969534.956944:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074083328 00000100:00100000:0.0:1783969534.956958:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074083328 00000100:00100000:0.0:1783969534.957158:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1783969534.957172:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+7:15596:x1870627074083328:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969534.957201:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969534.957227:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb25f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303cf4 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969534.957369:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783969534.957661:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb25f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cf4 expref: 9 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.957704:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93eab9b3c700) 00010000:00010000:0.0:1783969534.957708:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969534.957715:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb25f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cf4 expref: 9 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969534.957800:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddc000, rc 0) 00000100:00100000:0.0:1783969534.957935:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+8:15596:x1870627074083328:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 765us (1231us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1783969534.957944:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:2.0:1783969534.976321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969534.976585:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074083584 00000100:00100000:3.0:1783969534.976597:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074083584 00000100:00100000:3.0:1783969534.976673:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1783969534.976685:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+8:15596:x1870627074083584:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:3.0:1783969534.976767:0:17114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969534.976805:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb258 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303ced expref: 8 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.976830:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:3.0:1783969534.976837:0:17114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969534.976868:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.976884:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.976925:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969534.977535:0:17114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002eb3cd9c reply state 00000000a2035ff6 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.977571:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.977579:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:2.0:1783969534.977581:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1783969534.977585:0:17114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783969534.977597:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783969534.977744:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+9:15596:x1870627074083584:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 1058us (1435us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783969534.977754:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1783969534.981547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969534.981942:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074083840 00000100:00100000:2.0:1783969534.981956:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074083840 00000100:00100000:2.0:1783969534.982048:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1783969534.982060:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+9:15596:x1870627074083840:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1783969534.982349:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+10:15596:x1870627074083840:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 291us (823us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1783969534.982358:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1783969534.986236:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969534.988074:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074084096 00000100:00100000:3.0:1783969534.988097:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074084096 00000100:00100000:3.0:1783969534.988213:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1783969534.988231:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+10:15596:x1870627074084096:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1783969534.988272:0:19100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969534.988308:0:19100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cbb274 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303cfb expref: -99 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.988470:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.988492:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.988507:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.988525:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.988534:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.988542:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969534.989681:0:19100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783969534.989874:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.989885:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.989893:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.989901:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969534.989906:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.989914:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.989941:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93eab9b3c700) 00010000:00010000:3.0:1783969534.989945:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969534.989951:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.989957:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53600/0xea31253a47cbb27b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.989972:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.989978:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.990207:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.990212:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a1400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969534.990215:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.990221:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.990230:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93eab9b3cb00) 00010000:00010000:3.0:1783969534.990232:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969534.990236:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969534.990242:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb282 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.993336:0:19100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cbb274 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cfb expref: 12 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.993365:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93eab9b3c700) 00010000:00010000:2.0:1783969534.993368:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969534.993375:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52400/0xea31253a47cbb274 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303cfb expref: 12 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969534.994865:0:19100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea91a52400, rc 0) 00000100:00100000:2.0:1783969534.995126:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:968cb78a-c1fe-4a90-8549-da4cc0f9624e+11:15596:x1870627074084096:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 6894us (8897us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783969534.995138:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1783969535.002576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969535.002731:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074084224 00000100:00100000:2.0:1783969535.002744:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074084224 00000100:00100000:2.0:1783969535.002819:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:2.0:1783969535.002832:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+11:15596:x1870627074084224:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1783969535.002865:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969535.002892:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb290 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d02 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.003048:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.003066:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.003080:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969535.003110:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783969535.003115:0:17113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969535.003138:0:17113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.003167:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb290 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d02 expref: 13 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.003185:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d02 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.003216:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:2.0:1783969535.003219:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969535.003223:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bde00, rc 0) 00000100:00100000:2.0:1783969535.003300:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+12:15596:x1870627074084224:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 470us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969535.003308:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:2.0:1783969535.008337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969535.008517:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074084352 00000100:00100000:1.0:1783969535.008532:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074084352 00000100:00100000:1.0:1783969535.008613:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1783969535.008627:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac157a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+12:15596:x1870627074084352:12345-192.168.201.34@tcp:37:lfs.0 00000100:00100000:2.0:1783969535.019929:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac157a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+12:15596:x1870627074084352:12345-192.168.201.34@tcp:37:lfs.0 Request processed in 11277us (11579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969535.019952:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1783969535.029258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969535.029830:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074084608 00000100:00100000:3.0:1783969535.029844:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074084608 00000100:00100000:3.0:1783969535.029931:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1783969535.029943:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7290c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+12:15596:x1870627074084608:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1783969535.038736:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7290c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+13:15596:x1870627074084608:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 8773us (9471us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783969535.038757:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1783969535.124125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969535.124289:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074084736 00000100:00100000:2.0:1783969535.124303:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074084736 00000100:00100000:2.0:1783969535.124430:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:2.0:1783969535.124445:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+11:15601:x1870627074084736:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1783969535.124475:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969535.124506:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb29e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d09 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124599:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124617:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124649:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124663:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124672:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124679:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124788:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd800/0xea31253a47cbb2b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124797:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd800/0xea31253a47cbb2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124805:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd800/0xea31253a47cbb2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969535.124850:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783969535.124854:0:17112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783969535.124904:0:17112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd800/0xea31253a47cbb2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124932:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124940:0:17112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124956:0:17112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124963:0:17112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bc000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969535.124969:0:17112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124977:0:17112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.124991:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93eab9b3c700) 00010000:00010000:2.0:1783969535.124995:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969535.125156:0:17112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125165:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125181:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125187:0:17112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125193:0:17112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125198:0:17112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bd400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969535.125201:0:17112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125217:0:17112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125225:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93eab9b3cb00) 00010000:00010000:2.0:1783969535.125228:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969535.125230:0:17112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125236:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125266:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb29e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d09 expref: 13 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125279:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd800/0xea31253a47cbb2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d09 expref: 12 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.125287:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:2.0:1783969535.125289:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783969535.125291:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bd800, rc 0) 00000100:00100000:2.0:1783969535.125518:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+12:15601:x1870627074084736:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1075us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969535.125527:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1783969535.130372:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969535.130525:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074084864 00000100:00100000:2.0:1783969535.130537:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074084864 00000100:00100000:2.0:1783969535.130607:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1783969535.130619:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:15601:x1870627074084864:12345-192.168.201.34@tcp:900:bash.0 00000100:00100000:2.0:1783969535.130756:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:15601:x1870627074084864:12345-192.168.201.34@tcp:900:bash.0 Request processed in 138us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969535.130765:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1783969535.132687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969535.132980:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074085120 00000100:00100000:2.0:1783969535.132992:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074085120 00000100:00100000:2.0:1783969535.133078:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:2.0:1783969535.133091:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+12:15601:x1870627074085120:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1783969535.133129:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969535.133159:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb2ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d10 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.133329:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.133350:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d02 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.133360:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.133500:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d02 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.133520:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d02 expref: 12 pid: 17113 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969535.133538:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac157a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099340928:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969535.133654:0:17113:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea812edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969535.136521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969535.136858:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074085248 00000100:00100000:0.0:1783969535.136869:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074085248 00010000:00010000:0.0:1783969535.136946:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d02 expref: 13 pid: 17113 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969535.137007:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1783969535.137020:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+13:2391:x1870627074085248:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969535.137041:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969535.137049:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d02 expref: 13 pid: 17113 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.137063:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d02 expref: 13 pid: 17113 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.137092:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:0.0:1783969535.137115:0:17097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.137128:0:17097:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.137136:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.137164:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969535.137245:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:968cb78a-c1fe-4a90-8549-da4cc0f9624e+13:2391:x1870627074085248:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 227us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969535.137254:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00010000:00010000:2.0:1783969535.138044:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb297 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d02 expref: 12 pid: 17113 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969535.138069:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac157a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099340928:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969535.138096:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.138106:0:17113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.138112:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.138141:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.138152:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.138161:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141115:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141140:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141154:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969535.141192:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783969535.141601:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141610:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141616:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141622:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bd400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969535.141626:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141634:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141647:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:2.0:1783969535.141650:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969535.141654:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141660:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb2c1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969535.141938:0:17113:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000476648d4 reply state 000000008a852c1b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141951:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.141969:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93e98216e900) 00010000:00010000:2.0:1783969535.141972:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783969535.141975:0:17113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783969535.142023:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd000/0xea31253a47cbb2ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d10 expref: 15 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.142039:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d10 expref: 14 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.142046:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:2.0:1783969535.142048:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783969535.142050:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bc800, rc 0) 00000100:00100000:2.0:1783969535.142215:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+15:15601:x1870627074085120:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9126us (9551us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783969535.142236:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:3.0:1783969535.167583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969535.167738:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074085376 00000100:00100000:0.0:1783969535.167750:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074085376 00000100:00100000:0.0:1783969535.167835:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1783969535.167848:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+15:15601:x1870627074085376:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1783969535.167884:0:19100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969535.167925:0:19100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb2dd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d17 expref: -99 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.168036:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.168052:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.168067:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969535.168136:0:19100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783969535.168156:0:19100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969535.168187:0:19100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.168200:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.168229:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb2dd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d17 expref: 17 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.168251:0:19100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d17 expref: 16 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.168261:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:0.0:1783969535.168264:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969535.168269:0:19100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddca00, rc 0) 00000100:00100000:0.0:1783969535.168348:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+16:15601:x1870627074085376:12345-192.168.201.34@tcp:101:bash.0 Request processed in 503us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969535.168356:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:1.0:1783969535.180850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969535.180984:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074085632 00000100:00100000:2.0:1783969535.180997:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074085632 00000100:00100000:2.0:1783969535.181138:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:2.0:1783969535.181151:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+16:15601:x1870627074085632:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1783969535.181584:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+17:15601:x1870627074085632:12345-192.168.201.34@tcp:35:bash.0 Request processed in 435us (747us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783969535.181594:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00010000:00010000:3.0:1783969535.217524:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969535.324772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969535.328565:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074085888 00000100:00100000:0.0:1783969535.328588:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074085888 00000100:00100000:0.0:1783969535.328707:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1783969535.328721:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+17:15612:x1870627074085888:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969535.328756:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969535.328787:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb2eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d1e expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969535.328953:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783969535.329242:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb2eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d1e expref: 19 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.329282:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93eab9b3c700) 00010000:00010000:0.0:1783969535.329285:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969535.329292:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb2eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d1e expref: 19 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.329310:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddda00, rc 0) 00000100:00100000:0.0:1783969535.330172:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+18:15612:x1870627074085888:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1447us (5408us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1783969535.330185:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:3.0:1783969535.344661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969535.344873:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074086144 00000100:00100000:2.0:1783969535.344889:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074086144 00000100:00100000:2.0:1783969535.344978:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1783969535.344990:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+18:15612:x1870627074086144:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1783969535.345584:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+19:15612:x1870627074086144:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 593us (931us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1783969535.345595:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1783969535.425483:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969535.425611:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074086400 00000100:00100000:0.0:1783969535.425623:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074086400 00000100:00100000:0.0:1783969535.425729:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1783969535.425742:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+19:15615:x1870627074086400:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1783969535.425775:0:19100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969535.425804:0:19100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb2f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d25 expref: -99 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.425967:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb300 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.425985:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb300 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.426422:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb300 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969535.426441:0:19100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783969535.426612:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb2f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d25 expref: 22 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.426633:0:19100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb300 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d25 expref: 21 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.426643:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:0.0:1783969535.426646:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969535.426649:0:19100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddcc00, rc 0) 00000100:00100000:0.0:1783969535.426966:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+21:15615:x1870627074086400:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1225us (1499us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1783969535.426977:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:1.0:1783969535.443057:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969535.443117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969535.443262:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074086528 00000100:00100000:2.0:1783969535.443274:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074086528 00000100:00100000:2.0:1783969535.443364:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1783969535.443376:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+21:15615:x1870627074086528:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1783969535.443508:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.443528:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.443542:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.443589:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.443596:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.443603:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.443608:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bd400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969535.443614:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.443621:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.443654:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:2.0:1783969535.443657:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969535.443662:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969535.443680:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb30e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969535.443777:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+21:15615:x1870627074086528:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 403us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969535.443786:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:0.0:1783969535.448162:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074086656 00000100:00100000:0.0:1783969535.448184:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074086656 00000100:00100000:0.0:1783969535.448297:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1783969535.448311:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+21:2392:x1870627074086656:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969535.448332:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969535.448367:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddcc00/0xea31253a47cbb300 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d25 expref: 21 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969535.448414:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:0.0:1783969535.448421:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969535.448497:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+20:2392:x1870627074086656:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 190us (5379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969535.448506:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1783969535.463959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969535.464091:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074086912 00000100:00100000:0.0:1783969535.464104:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074086912 00000100:00100000:0.0:1783969535.464195:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1783969535.464208:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+20:15615:x1870627074086912:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1783969535.464543:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+21:15615:x1870627074086912:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 336us (596us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1783969535.464552:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000040:00080000:1.0:1783969535.603439:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783969535.604249:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783969535.906456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969535.907546:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074087168 00000100:00100000:3.0:1783969535.907595:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074087168 00000100:00100000:3.0:1783969535.907699:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:3.0:1783969535.907722:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+21:15646:x1870627074087168:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:3.0:1783969535.907759:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969535.907933:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb315 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d2c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969535.908153:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb31c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969535.908172:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb31c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969535.908191:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb31c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969535.908204:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783969535.908427:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb315 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d2c expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969535.908460:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb31c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d2c expref: 23 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969535.908471:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:3.0:1783969535.908475:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969535.908480:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a1c00, rc 0) 00000100:00100000:3.0:1783969535.908855:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+23:15646:x1870627074087168:12345-192.168.201.34@tcp:101:cat.0 Request processed in 1065us (2341us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1783969535.908865:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1783969535.934738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969535.936462:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074087424 00000100:00100000:0.0:1783969535.936484:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074087424 00000100:00100000:0.0:1783969535.936595:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1783969535.936609:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+23:15646:x1870627074087424:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:0.0:1783969535.937074:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+24:15646:x1870627074087424:12345-192.168.201.34@tcp:35:cat.0 Request processed in 464us (2347us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1783969535.937083:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1783969535.944733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969535.944833:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074087552 00000100:00100000:3.0:1783969535.944848:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074087552 00000100:00100000:3.0:1783969535.944951:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1783969535.944965:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+24:2393:x1870627074087552:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969535.945002:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969535.945036:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb31c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d2c expref: 24 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969535.945061:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:3.0:1783969535.945067:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969535.945135:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+23:2393:x1870627074087552:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 173us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969535.945148:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1783969536.026262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969536.026455:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074087808 00000100:00100000:2.0:1783969536.026471:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074087808 00000100:00100000:2.0:1783969536.026602:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:2.0:1783969536.026619:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+23:15652:x1870627074087808:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:2.0:1783969536.026657:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969536.026688:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb32a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d33 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.027132:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.027155:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d10 expref: 24 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.027166:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d17 expref: 24 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.027204:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.027256:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d17 expref: 24 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.027272:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d17 expref: 24 pid: 19100 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.027290:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac157a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099341056:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969536.027500:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d10 expref: 24 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.027513:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d10 expref: 24 pid: 17113 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.027524:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1578e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099341184:192.168.201.34@tcp:104: 00000100:00100000:2.0:1783969536.027567:0:17113:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064b40 going to sleep for 11 seconds 00000100:00080000:0.0:1783969536.029654:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969536.053629:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969536.053729:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.054872:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074087936 00000100:00100000:3.0:1783969536.054894:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074087936 00010000:00010000:3.0:1783969536.055005:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d17 expref: 25 pid: 19100 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969536.055075:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074088064 00000100:00100000:3.0:1783969536.055082:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074088064 00010000:00010000:3.0:1783969536.055107:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d10 expref: 26 pid: 17113 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969536.055132:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1783969536.055147:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+26:2392:x1870627074087936:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969536.055174:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969536.055185:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d17 expref: 26 pid: 19100 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.055232:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d17 expref: 26 pid: 19100 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.055263:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:3.0:1783969536.055269:0:17098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.055278:0:17098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.055285:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969536.055488:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+26:2392:x1870627074087936:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 342us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969536.055499:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1783969536.055531:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1783969536.055543:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea84eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+25:2392:x1870627074088064:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969536.055556:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969536.055563:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d10 expref: 25 pid: 17113 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.055576:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d10 expref: 25 pid: 17113 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.055592:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:3.0:1783969536.055598:0:17098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.055624:0:17098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.055633:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.055661:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969536.055686:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea84eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+25:2392:x1870627074088064:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 147us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969536.055693:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00010000:00010000:2.0:1783969536.059100:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb2e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d17 expref: 24 pid: 19100 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.059135:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac157a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099341056:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969536.059150:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc800/0xea31253a47cbb2cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d10 expref: 23 pid: 17113 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.059186:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1578e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099341184:192.168.201.34@tcp:104: 00010000:00010000:2.0:1783969536.059214:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.059226:0:17113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.059233:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969536.059262:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783969536.059540:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bd400/0xea31253a47cbb32a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d33 expref: 24 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.059558:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bde00/0xea31253a47cbb331 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d33 expref: 23 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.059568:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:2.0:1783969536.059571:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969536.059575:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bde00, rc 0) 00000100:00100000:2.0:1783969536.059683:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+23:15652:x1870627074087808:12345-192.168.201.34@tcp:101:dd.0 Request processed in 33067us (33434us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783969536.059696:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1783969536.080867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.081460:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074088192 00000100:00100000:0.0:1783969536.081482:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074088192 00000100:00100000:0.0:1783969536.081604:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1783969536.081624:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+23:15652:x1870627074088192:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:0.0:1783969536.081665:0:19100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969536.081700:0:19100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb33f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d3a expref: -99 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.081757:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.081775:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.081789:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.082002:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb33f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d3a expref: 25 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.082029:0:19100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d3a expref: 24 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.082040:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:0.0:1783969536.082045:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783969536.082049:0:19100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddde00, rc 0) 00000100:00100000:0.0:1783969536.082165:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+24:15652:x1870627074088192:12345-192.168.201.34@tcp:101:dd.0 Request processed in 547us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.082175:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1783969536.092290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.092734:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074088448 00000100:00100000:3.0:1783969536.092747:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074088448 00000100:00100000:3.0:1783969536.092834:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1783969536.092845:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+24:15652:x1870627074088448:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:3.0:1783969536.093291:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.093311:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.093324:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969536.093373:0:17114:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1783969536.093430:0:17114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003bf0da0d reply state 00000000999792d6 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.093445:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.093473:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:3.0:1783969536.093476:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969536.093480:0:17114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969536.093703:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+27:15652:x1870627074088448:12345-192.168.201.34@tcp:36:dd.0 Request processed in 859us (1427us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1783969536.093721:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000020:00080000:3.0:1783969536.093727:0:17114:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783969536.135648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.136252:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074088576 00000100:00100000:0.0:1783969536.136269:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074088576 00000100:00100000:0.0:1783969536.136457:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:0.0:1783969536.136478:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+27:15652:x1870627074088576:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:0.0:1783969536.136518:0:19100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969536.136552:0:19100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb354 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d41 expref: -99 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.136651:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb354 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d41 expref: 28 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.136673:0:19100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb354 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d41 expref: 28 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.136751:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:0.0:1783969536.136755:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969536.136760:0:19100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddc000, rc 0) 00000100:00100000:0.0:1783969536.137177:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+28:15652:x1870627074088576:12345-192.168.201.34@tcp:101:dd.0 Request processed in 707us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.137187:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1783969536.178680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.180704:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074088832 00000100:00100000:3.0:1783969536.180725:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074088832 00000100:00100000:3.0:1783969536.180842:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1783969536.180854:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+28:15652:x1870627074088832:12345-192.168.201.34@tcp:103:dd.0 00010000:00010000:3.0:1783969536.180890:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969536.180933:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb354 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d41 expref: 28 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.180960:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:3.0:1783969536.180974:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969536.181069:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+27:15652:x1870627074088832:12345-192.168.201.34@tcp:103:dd.0 Request processed in 217us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969536.181078:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1783969536.188134:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.188270:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074088960 00000100:00100000:3.0:1783969536.188283:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074088960 00000100:00100000:3.0:1783969536.188365:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:3.0:1783969536.188417:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+27:15652:x1870627074088960:12345-192.168.201.34@tcp:58:dd.0 00010000:00010000:3.0:1783969536.188567:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.188613:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.188627:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969536.191699:0:17114:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969536.194079:0:17114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1783969536.194352:0:17114:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1783969536.194530:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+27:15652:x1870627074088960:12345-192.168.201.34@tcp:58:dd.0 Request processed in 6146us (6402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969536.194546:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1783969536.205924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.207033:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074089088 00000100:00100000:0.0:1783969536.207050:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074089088 00000100:00100000:0.0:1783969536.207152:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1783969536.207165:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea836e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+27:15652:x1870627074089088:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:0.0:1783969536.207194:0:19100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969536.207221:0:19100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd800/0xea31253a47cbb362 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d48 expref: -99 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.207298:0:19100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.207313:0:19100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd800/0xea31253a47cbb362 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d48 expref: 28 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.207341:0:19100:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.207360:0:19100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd800/0xea31253a47cbb362 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d48 expref: 28 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.207377:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:0.0:1783969536.207454:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969536.207459:0:19100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd800/0xea31253a47cbb362 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d48 expref: 28 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.207469:0:19100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddd800, rc 0) 00000100:00100000:0.0:1783969536.207551:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea836e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+28:15652:x1870627074089088:12345-192.168.201.34@tcp:101:dd.0 Request processed in 389us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.207560:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00010000:00010000:0.0:1783969536.244414:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969536.369329:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099341312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969536.369476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969536.369616:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099341312 00000100:00100000:1.0:1783969536.369628:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099341312 00000100:00100000:1.0:1783969536.369732:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969536.369744:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099341312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969536.369793:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783969536.369852:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099341312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969536.369860:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969536.369927:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099341312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783969536.370000:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1783969536.624810:0:17148:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783969536.624824:0:17148:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969536.624862:0:17148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783969536.624873:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783969536.625138:0:17148:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea86ffb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17148:1870627099341440:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783969536.625266:0:17148:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e80f180 going to sleep for 11 seconds 00000100:00100000:3.0:1783969536.636020:0:17148:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea86ffb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17148:1870627099341440:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783969536.641434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969536.641558:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074089216 00000100:00100000:1.0:1783969536.641572:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074089216 00000100:00100000:1.0:1783969536.641651:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1783969536.641663:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac157a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+28:15653:x1870627074089216:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783969536.641706:0:17113:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783969536.643108:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac157a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+28:15653:x1870627074089216:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 1434us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969536.643125:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1783969536.659046:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.659181:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074089344 00000100:00100000:0.0:1783969536.659196:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074089344 00000100:00100000:0.0:1783969536.659303:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1783969536.659320:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+28:15653:x1870627074089344:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783969536.659547:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.659572:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.659588:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.659782:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.659804:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.659817:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.659873:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.659883:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.659901:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969536.659964:0:19100:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783969536.659968:0:19100:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783969536.659982:0:19100:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.659993:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660000:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660007:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660014:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddd600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969536.660018:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660025:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660037:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93eab9b3c400) 00010000:00010000:0.0:1783969536.660049:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969536.660055:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660061:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb369 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660148:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660157:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660163:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660168:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddc800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969536.660171:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660177:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660186:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93ea83c43600) 00010000:00010000:0.0:1783969536.660188:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969536.660191:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660196:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc800/0xea31253a47cbb370 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660217:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660228:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660234:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660239:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddc000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969536.660243:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660249:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660258:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:0.0:1783969536.660261:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969536.660264:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.660270:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddc000/0xea31253a47cbb377 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969536.660369:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+28:15653:x1870627074089344:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 1050us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.660443:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:2.0:1783969536.674215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.674541:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074089600 00000100:00100000:3.0:1783969536.674555:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074089600 00000100:00100000:3.0:1783969536.674687:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1783969536.674699:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac157b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+28:15653:x1870627074089600:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969536.674742:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969536.674772:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb37e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d4f expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.674943:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.674992:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675006:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969536.675022:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783969536.675129:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675138:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675145:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675152:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:3.0:1783969536.675157:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675165:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675181:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:3.0:1783969536.675185:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783969536.675190:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675197:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb385 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675247:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb37e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d4f expref: 30 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675266:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93eab9b3c400) 00010000:00010000:3.0:1783969536.675269:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969536.675274:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb37e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d4f expref: 30 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.675284:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a0400, rc 0) 00000100:00100000:3.0:1783969536.675372:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac157b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+29:15653:x1870627074089600:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 676us (1172us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1783969536.675446:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1783969536.689517:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.690964:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074089728 00000100:00100000:0.0:1783969536.690984:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074089728 00000100:00100000:0.0:1783969536.691081:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1783969536.691094:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+29:15653:x1870627074089728:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783969536.691146:0:19100:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783969536.691350:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+29:15653:x1870627074089728:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 257us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.691359:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1783969536.698759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969536.699225:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074089984 00000100:00100000:1.0:1783969536.699241:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074089984 00000100:00100000:1.0:1783969536.699320:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:1.0:1783969536.699332:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+29:15653:x1870627074089984:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969536.699360:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969536.699438:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cbb393 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d56 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783969536.700451:0:17113:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:1.0:1783969536.700467:0:17113:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1783969536.700495:0:17113:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1783969536.700701:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6000/0xea31253a47cbb39a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.700720:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6000/0xea31253a47cbb39a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.702066:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6000/0xea31253a47cbb39a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.702311:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6200/0xea31253a47cbb393 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d56 expref: 32 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.702339:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6000/0xea31253a47cbb39a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d56 expref: 31 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.702350:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93e982253e00) 00010000:00010000:1.0:1783969536.702354:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969536.702357:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6000, rc 0) 00000100:00100000:1.0:1783969536.702571:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+31:15653:x1870627074089984:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3241us (3826us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1783969536.702582:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:3.0:1783969536.709692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.712432:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074090240 00000100:00100000:0.0:1783969536.712452:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074090240 00000100:00100000:0.0:1783969536.712549:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:0.0:1783969536.712564:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+31:15653:x1870627074090240:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783969536.712651:0:19100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969536.712700:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6000/0xea31253a47cbb39a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d56 expref: 31 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.712727:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93e982253e00) 00010000:00010000:0.0:1783969536.712742:0:19100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969536.712776:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713310:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713327:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713348:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713355:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713361:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713486:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713494:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713501:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713508:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddd600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969536.713514:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713522:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713531:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:0.0:1783969536.713534:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969536.713539:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713546:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd600/0xea31253a47cbb3a8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713557:0:19100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713563:0:19100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713569:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713581:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddca00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:0.0:1783969536.713584:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713590:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713597:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7f75c4ac (ffff93ea83c43600) 00010000:00010000:0.0:1783969536.713600:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969536.713602:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.713608:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddca00/0xea31253a47cbb3af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7f75c4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969536.713745:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+30:15653:x1870627074090240:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1182us (4078us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783969536.716574:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.716677:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074090368 00000100:00100000:3.0:1783969536.716691:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074090368 00000100:00100000:3.0:1783969536.716773:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1783969536.716786:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+31:15653:x1870627074090368:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969536.716825:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969536.716857:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d5d expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.716916:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb3bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.716933:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb3bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.716946:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb3bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.717125:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d5d expref: 33 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.717149:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0800/0xea31253a47cbb3bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d5d expref: 32 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.717159:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:3.0:1783969536.717163:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783969536.717167:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a0800, rc 0) 00000100:00100000:0.0:1783969536.717267:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:3.0:1783969536.718434:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+31:15653:x1870627074090368:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1640us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969536.718447:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:1.0:1783969536.724503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.725176:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074090624 00000100:00100000:3.0:1783969536.725482:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074090624 00000100:00100000:3.0:1783969536.725585:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1783969536.725598:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+31:15653:x1870627074090624:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969536.725719:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.725750:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.725764:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969536.726037:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1783969536.726052:0:17112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 598853669519ns, next at 599853663694ns, rc = 0 00000004:00010000:3.0:1783969536.726142:0:17112:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca48e7c7 reply state 000000004b1de679 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.726157:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.726166:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:3.0:1783969536.726169:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783969536.726173:0:17112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969536.730011:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+33:15653:x1870627074090624:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 4396us (5502us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1783969536.730031:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:0.0:1783969536.733297:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969536.733514:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074090752 00000100:00100000:1.0:1783969536.733527:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074090752 00000100:00100000:1.0:1783969536.733603:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1783969536.733616:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+33:15653:x1870627074090752:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969536.733650:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969536.733680:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d64 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.733764:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d64 expref: 34 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.733782:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d64 expref: 34 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.734104:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:1.0:1783969536.734109:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969536.734113:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de7200, rc 0) 00000100:00100000:1.0:1783969536.734201:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+34:15653:x1870627074090752:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 577us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969536.734210:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1783969536.742465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.742569:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074090880 00000100:00100000:3.0:1783969536.742582:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074090880 00000100:00100000:3.0:1783969536.742670:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:3.0:1783969536.742683:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2391:x1870627074090880:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783969536.743105:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2391:x1870627074090880:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 423us (654us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1783969536.743114:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00080000:0.0:1783969536.743319:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969536.746047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969536.748168:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074091136 00000100:00100000:2.0:1783969536.748186:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074091136 00000100:00100000:2.0:1783969536.748299:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1783969536.748313:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+34:15653:x1870627074091136:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783969536.748677:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+35:15653:x1870627074091136:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 365us (2644us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1783969536.748688:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1783969536.754343:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.754610:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074091392 00000100:00100000:0.0:1783969536.754623:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074091392 00000100:00100000:0.0:1783969536.754713:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1783969536.754727:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+35:15653:x1870627074091392:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783969536.754895:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+35:15653:x1870627074091392:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 162us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.754904:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1783969536.761544:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969536.761810:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074091520 00000100:00100000:1.0:1783969536.761824:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074091520 00000100:00100000:1.0:1783969536.761925:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:1.0:1783969536.761938:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+35:15653:x1870627074091520:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969536.762143:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969536.762177:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cbb3d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d6b expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.762562:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6e00/0xea31253a47cbb3d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.762585:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6e00/0xea31253a47cbb3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.762600:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6e00/0xea31253a47cbb3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969536.762660:0:17114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783969536.762761:0:17114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6e00/0xea31253a47cbb3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.762797:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7c00/0xea31253a47cbb3d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d6b expref: 37 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.762821:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6e00/0xea31253a47cbb3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d6b expref: 36 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.762832:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:1.0:1783969536.762835:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783969536.762840:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983de6e00, rc 0) 00000100:00100000:1.0:1783969536.763331:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+36:15653:x1870627074091520:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1392us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969536.763344:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:1.0:1783969536.768585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969536.768693:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074091648 00000100:00100000:2.0:1783969536.768706:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074091648 00000100:00100000:2.0:1783969536.768879:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1783969536.768901:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2391:x1870627074091648:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969536.768925:0:18622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969536.768952:0:18622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d72 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969536.768997:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5536ff, blocks: 0x0 00010000:00010000:2.0:1783969536.769023:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=598s v=(0 0) 00010000:00010000:2.0:1783969536.769028:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969536.769041:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d72 expref: 7 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.769061:0:18622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d72 expref: 7 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.769101:0:18622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea837bcc00, rc 0) 00000100:00100000:2.0:1783969536.769175:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+7:2391:x1870627074091648:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 286us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969536.769182:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1783969536.772043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969536.772462:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074091904 00000100:00100000:1.0:1783969536.772475:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074091904 00000100:00100000:1.0:1783969536.772551:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1783969536.772563:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+36:15653:x1870627074091904:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783969536.772709:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+36:15653:x1870627074091904:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 149us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969536.772718:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1783969536.775853:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.776024:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074092032 00000100:00100000:3.0:1783969536.776036:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074092032 00000100:00100000:3.0:1783969536.776117:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1783969536.776129:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+36:15653:x1870627074092032:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1783969536.780728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.780827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969536.781022:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074092288 00000100:00100000:1.0:1783969536.781038:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074092288 00000100:00100000:1.0:1783969536.781130:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:1.0:1783969536.781143:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2393:x1870627074092288:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969536.781258:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e983fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2393:x1870627074092288:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 119us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969536.781267:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:2.0:1783969536.781739:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074092160 00000100:00100000:2.0:1783969536.781746:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074092160 00000100:00100000:2.0:1783969536.781799:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:2.0:1783969536.781808:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2393:x1870627074092160:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969536.781853:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67a3c0e1-9e25-4885-b9a1-31708fbd2c77+13:2393:x1870627074092160:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 48us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969536.781860:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00080000:3.0:1783969536.782329:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783969536.785143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.785188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.785219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.785249:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074092800 00000100:00100000:3.0:1783969536.785272:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074092800 00000100:00100000:0.0:1783969536.785284:0:18923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074092416 00000100:00100000:0.0:1783969536.785297:0:18923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074092416 00000100:00100000:3.0:1783969536.785345:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1783969536.785358:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074092800:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1783969536.785472:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074092800:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969536.785578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000001:00080000:2.0:1783969536.785593:0:17092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1783969536.785612:0:17092:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1783969536.785671:0:17092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1783969536.785735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969536.785766:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074092544 00000100:00100000:1.0:1783969536.785771:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074092544 00000100:00100000:1.0:1783969536.785808:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074092672 00000100:00100000:1.0:1783969536.785810:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074092672 00000100:00100000:1.0:1783969536.785826:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:1.0:1783969536.785833:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab73e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+7:2394:x1870627074092544:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969536.785878:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab73e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+7:2394:x1870627074092544:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 46us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969536.785896:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:1.0:1783969536.785914:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:1.0:1783969536.785920:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074092672:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1783969536.785941:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074092672:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969536.785946:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00010000:00010000:2.0:1783969536.786362:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786416:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786425:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786432:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52800 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.786437:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786463:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786483:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93eab9b3cb00) 00010000:00010000:2.0:1783969536.786486:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969536.786493:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786500:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52800/0xea31253a47cbb219 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786528:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786535:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786541:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786546:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a53c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.786549:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786554:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786562:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:2.0:1783969536.786564:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969536.786567:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786580:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a53c00/0xea31253a47cbb220 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786597:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786604:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786609:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786614:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bc000 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.786618:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786624:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786632:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93e98216e900) 00010000:00010000:2.0:1783969536.786635:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969536.786638:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786643:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc000/0xea31253a47cbb2c8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786658:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786664:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786676:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786681:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a1c00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.786685:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786691:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786700:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:2.0:1783969536.786703:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969536.786705:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786711:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1c00/0xea31253a47cbb34d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786726:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786732:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786739:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786743:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.786746:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.786763:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.788145:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:2.0:1783969536.788150:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783969536.788156:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.788163:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0400/0xea31253a47cbb3c4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.788450:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.788459:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.788466:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.788473:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea91a52e00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.788476:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.788483:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.788492:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93eab9b3c800) 00010000:00010000:2.0:1783969536.788495:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1783969536.788497:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.788520:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea91a52e00/0xea31253a47cbb26d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.788542:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969536.788565:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac1578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099341568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783969536.788650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969536.788704:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074092928 00000100:00100000:2.0:1783969536.788712:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074092928 00000100:00100000:0.0:1783969536.788894:0:18923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099341568 00000100:00100000:0.0:1783969536.788899:0:18923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099341568 00000100:00100000:0.0:1783969536.788937:0:18923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:0.0:1783969536.788948:0:18923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074092416:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1783969536.789161:0:18923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074092416:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 214us (3938us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.789170:0:18923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:0.0:1783969536.789187:0:18923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783969536.789194:0:18923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac157b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099341568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783969536.789474:0:18923:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783969536.789479:0:18923:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1783969536.789481:0:18923:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783969536.789484:0:18923:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783969535 -> 1783969535 00002000:00010000:0.0:1783969536.789487:0:18923:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783969536.789538:0:18923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac157b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1870627099341568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 344us (887us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783969536.789545:0:18923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1783969536.789720:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969536.789726:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969536.789732:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783969536.789736:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969536.789848:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+15:15653:x1870627074092032:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 13721us (14009us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.789858:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1783969536.794929:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:1.0:1783969536.795207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.795374:0:18923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074093056 00000100:00100000:0.0:1783969536.795436:0:18923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074093056 00000100:00100000:0.0:1783969536.795521:0:18923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1783969536.795534:0:18923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+7:2392:x1870627074093056:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783969536.795698:0:18923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+7:2392:x1870627074093056:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 165us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.795706:0:18923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:1.0:1783969536.801634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969536.801856:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:2.0:1783969536.801899:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074092928:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1783969536.802192:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:968cb78a-c1fe-4a90-8549-da4cc0f9624e+5:2394:x1870627074092928:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 311us (16457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969536.802201:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000004:00080000:2.0:1783969536.802775:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93eac1578000/2, rc 0, transno 8589934596 00000100:00100000:2.0:1783969536.802786:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac1578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099341568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783969536.803881:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074093312 00000100:00100000:3.0:1783969536.803906:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074093312 00000100:00100000:3.0:1783969536.803992:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:3.0:1783969536.804002:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+15:15653:x1870627074093312:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969536.804101:0:17114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969536.804136:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6e00/0xea31253a47cbb3d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d6b expref: 15 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.804157:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:3.0:1783969536.804162:0:17114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969536.804199:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0600/0xea31253a47cbb3e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.804543:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0600/0xea31253a47cbb3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.804558:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0600/0xea31253a47cbb3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969536.804822:0:17114:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000171f71f7 reply state 000000004fe707b9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0600/0xea31253a47cbb3e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.804837:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0600/0xea31253a47cbb3e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.804854:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:3.0:1783969536.804857:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783969536.805330:0:17114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969536.805562:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+16:15653:x1870627074093312:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1558us (3940us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1783969536.805572:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1783969536.812712:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.812932:0:18923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074093440 00000100:00100000:0.0:1783969536.812944:0:18923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074093440 00000100:00100000:0.0:1783969536.813041:0:18923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:0.0:1783969536.813053:0:18923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+7:15653:x1870627074093440:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969536.813077:0:18923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969536.813101:0:18923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d79 expref: -99 pid: 18923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.813142:0:18923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d72 expref: 8 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.813153:0:18923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969536.813157:0:18923:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969536.813164:0:18923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 8 pid: 18923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.813211:0:18923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d72 expref: 8 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.813462:0:18923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d72 expref: 8 pid: 18622 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969536.813480:0:18923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:18923:1870627099341696:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969536.813631:0:18923:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea91353000 going to sleep for 11 seconds 00000100:00100000:1.0:1783969536.835921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969536.836256:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074093568 00000100:00100000:2.0:1783969536.836269:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074093568 00010000:00010000:2.0:1783969536.836325:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d72 expref: 9 pid: 18622 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.836375:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1783969536.836422:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+9:2392:x1870627074093568:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969536.836445:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969536.836472:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d72 expref: 9 pid: 18622 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.836514:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d72 expref: 9 pid: 18622 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.836549:0:17099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969536.836555:0:17099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969536.836563:0:17099:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 9 pid: 18923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.836576:0:17099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 9 pid: 18923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.836624:0:17099:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 9 pid: 18923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.836642:0:17099:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac157bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17099:1870627099341824:192.168.201.34@tcp:105: 00000100:00100000:2.0:1783969536.836743:0:17099:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea860646c0 going to sleep for 11 seconds 00010000:00010000:0.0:1783969536.838568:0:18923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086dbe447/0xea31253a47cbb3e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d72 expref: 9 pid: 18622 timeout: 698 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969536.838598:0:18923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:18923:1870627099341696:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969536.838645:0:18923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 8 pid: 18923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.838663:0:18923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93e983ddd600, rc 0) 00000100:00100000:0.0:1783969536.838741:0:18923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+8:15653:x1870627074093440:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 25690us (26044us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.838751:0:18923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:3.0:1783969536.841808:0:17099:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac157bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17099:1870627099341824:192.168.201.34@tcp:105: 00010000:00010000:3.0:1783969536.841844:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969536.841939:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+7:2392:x1870627074093568:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 5519us (6057us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969536.841953:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1783969536.844437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.844558:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074093696 00000100:00100000:0.0:1783969536.844572:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074093696 00000100:00100000:0.0:1783969536.844647:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:0.0:1783969536.844659:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+7:2392:x1870627074093696:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783969536.844855:0:18622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783969536.844859:0:18622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1783969535 00002000:00010000:0.0:1783969536.844877:0:18622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1783969534 00002000:00010000:0.0:1783969536.844905:0:18622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783969535 -> 1783969535 00002000:00010000:0.0:1783969536.844907:0:18622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783969536.845855:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+8:2392:x1870627074093696:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 1189us (1422us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783969536.845894:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:1.0:1783969536.850801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.851306:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074093824 00000100:00100000:0.0:1783969536.851320:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074093824 00000100:00100000:0.0:1783969536.851502:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:0.0:1783969536.851515:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+8:2391:x1870627074093824:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783969536.851573:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.851599:0:18620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 8 pid: 18923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.851608:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969536.851614:0:18620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969536.851619:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.851664:0:18620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 8 pid: 18923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.851679:0:18620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 8 pid: 18923 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969536.851721:0:18620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18620:1870627099341952:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969536.851877:0:18620:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea91353000 going to sleep for 11 seconds 00000100:00100000:3.0:1783969536.856654:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969536.856763:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074093952 00000100:00100000:2.0:1783969536.856775:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074093952 00010000:00010000:2.0:1783969536.856827:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 9 pid: 18923 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.856877:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1783969536.856898:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+9:2391:x1870627074093952:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969536.856937:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969536.856980:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 9 pid: 18923 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.856996:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 9 pid: 18923 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.857030:0:17097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969536.857036:0:17097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969536.857044:0:17097:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.857055:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.857082:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969536.857221:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb3ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d79 expref: 9 pid: 18923 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969536.857240:0:18620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18620:1870627099341952:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969536.857274:0:18620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.857288:0:18620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.857295:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.857319:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.857329:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.857338:0:18620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.857360:0:18620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddda00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969536.857365:0:18620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.857375:0:18620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.857428:0:18620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.857437:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3652de8/0xea31253a47cbb3f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.864508:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+8:2391:x1870627074093952:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 7602us (7848us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969536.864530:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1783969536.865902:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a97a32d-150e-48b4-af23-95f3386e92f5+7:2391:x1870627074093824:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 14372us (15096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.865919:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:3.0:1783969536.875658:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1783969536.875797:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074094208 00000100:00100000:0.0:1783969536.875810:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074094208 00000100:00100000:0.0:1783969536.875903:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:0.0:1783969536.875917:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+16:15653:x1870627074094208:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783969536.876051:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.876074:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d3a expref: 16 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.876110:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.876157:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d3a expref: 16 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.876173:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d3a expref: 16 pid: 19100 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969536.876191:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099342080:192.168.201.34@tcp:104: 00000100:00100000:0.0:1783969536.876311:0:17113:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea91353000 going to sleep for 11 seconds 00000100:00100000:0.0:1783969536.881452:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099342080:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969536.881498:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969536.885276:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969536.885584:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074094336 00000100:00100000:2.0:1783969536.885598:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074094336 00010000:00010000:2.0:1783969536.885656:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d3a expref: 17 pid: 19100 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.885709:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1783969536.885721:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf853800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+17:2391:x1870627074094336:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969536.885763:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969536.885777:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d3a expref: 17 pid: 19100 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.885796:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d3a expref: 17 pid: 19100 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.885831:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddde00/0xea31253a47cbb346 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d3a expref: 17 pid: 19100 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.885855:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:2.0:1783969536.885862:0:17099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd800/0xea31253a47cbb362 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d48 expref: 16 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.885874:0:17099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.885891:0:17099:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.885901:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.885942:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969536.886021:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf853800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a97a32d-150e-48b4-af23-95f3386e92f5+16:2391:x1870627074094336:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 301us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969536.886032:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00010000:00010000:1.0:1783969536.887246:0:17113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.887264:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.887595:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.887617:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d64 expref: 16 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.887627:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.887687:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d64 expref: 16 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.887704:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d64 expref: 16 pid: 17114 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969536.887724:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea86ff9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099342208:192.168.201.34@tcp:104: 00000100:00100000:1.0:1783969536.887827:0:17113:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea8e80f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969536.894500:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969536.894606:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074094464 00000100:00100000:2.0:1783969536.894617:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074094464 00010000:00010000:2.0:1783969536.894681:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d64 expref: 17 pid: 17114 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.894729:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1783969536.894740:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+17:2393:x1870627074094464:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969536.894761:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969536.894769:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d64 expref: 17 pid: 17114 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.894784:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d64 expref: 17 pid: 17114 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.894814:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:2.0:1783969536.894820:0:17098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.894832:0:17098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.894841:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.894877:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969536.894957:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+17:2393:x1870627074094464:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 218us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969536.894981:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00010000:00010000:0.0:1783969536.895153:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de7200/0xea31253a47cbb3cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d64 expref: 16 pid: 17114 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969536.895173:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea86ff9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099342208:192.168.201.34@tcp:104: 00010000:00010000:0.0:1783969536.895202:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.895212:0:17113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.895218:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969536.895374:0:17113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1783969536.895572:0:17113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1783969536.895613:0:17113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1783969536.895726:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17113:1870627099342336:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783969536.895799:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969536.895849:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099342336 00000100:00100000:0.0:1783969536.895854:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099342336 00000100:00100000:0.0:1783969536.895910:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783969536.895919:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17113:x1870627099342336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783969536.897662:0:17113:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea91353b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969536.897731:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea85f95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17113:1870627099342336:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1783969536.898103:0:17113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1783969536.898216:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac157bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17113:1870627099342464:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783969536.898283:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969536.898324:0:17113:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea86064480 going to sleep for 11 seconds 00000100:00100000:3.0:1783969536.899105:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099342464 00000100:00100000:3.0:1783969536.899117:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099342464 00000100:00100000:3.0:1783969536.899192:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783969536.899203:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac157b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17113:x1870627099342464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783969536.899451:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac157b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:17113:x1870627099342464:12345-0@lo:1000:mdt00_001.0 Request processed in 249us (1167us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1783969536.899460:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783969536.899631:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17113:x1870627099342336:12345-0@lo:1000:mdt00_001.0 Request processed in 3710us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969536.899640:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783969536.900539:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac157bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17113:1870627099342464:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1783969536.900609:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900621:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900629:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900636:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983de6600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.900641:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900650:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900674:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:2.0:1783969536.900677:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969536.900681:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900689:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983de6600/0xea31253a47cbb403 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900728:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900734:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900764:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900770:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a1400 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.900773:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900779:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900789:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:2.0:1783969536.900792:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969536.900801:0:17113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd800/0xea31253a47cbb362 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d48 expref: 19 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900815:0:17113:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd800/0xea31253a47cbb362 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d48 expref: 19 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900825:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd800/0xea31253a47cbb362 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d48 expref: 19 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.900912:0:17113:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddd800/0xea31253a47cbb362 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d48 expref: 19 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.900929:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eac157ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099342592:192.168.201.34@tcp:105: 00000100:00100000:2.0:1783969536.901035:0:17113:0:(client.c:2702:ptlrpc_set_wait()) set ffff93ea860640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969536.904774:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eac157ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17113:1870627099342592:192.168.201.34@tcp:105: 00010000:00010000:2.0:1783969536.904839:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.904851:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a1400/0xea31253a47cbb35b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.904904:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.904920:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.904934:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.904947:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.904954:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.904961:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.904968:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bc600 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.904982:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.904990:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.905003:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:2.0:1783969536.905014:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969536.905018:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.905024:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bc600/0xea31253a47cbb40a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.905035:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.905042:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.905048:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.905053:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddda00 already unused, calling callback (ffffffffc192e4f0) 00010000:00010000:2.0:1783969536.905056:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.905063:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.905071:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:2.0:1783969536.905074:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969536.905077:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.905082:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93e983ddda00/0xea31253a47cbb3fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.905316:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+19:15653:x1870627074094208:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 29401us (29672us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1783969536.905338:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000020:00080000:2.0:1783969536.905345:0:17113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783969536.906519:0:17148:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783969536.906529:0:17148:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969536.906551:0:17148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783969536.906558:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783969536.907567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969536.909411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1783969536.913029:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074094592 00000100:00100000:2.0:1783969536.913051:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074094592 00000100:00100000:2.0:1783969536.913114:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074094848 00000100:00100000:2.0:1783969536.913118:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074094848 00000100:00100000:2.0:1783969536.913140:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1783969536.913151:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eab7291050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+20:15652:x1870627074094592:12345-192.168.201.34@tcp:49:dd.0 00000100:00100000:2.0:1783969536.913328:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eab7291050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+20:15652:x1870627074094592:12345-192.168.201.34@tcp:49:dd.0 Request processed in 178us (5773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969536.913336:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1783969536.913418:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1783969536.913425:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+19:15653:x1870627074094848:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783969536.913729:0:17116:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783969536.913775:0:17116:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1783969536.913817:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.913841:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.913855:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.913865:0:17116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.913872:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969536.919291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969536.919684:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074094976 00000100:00100000:3.0:1783969536.919712:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074094976 00000100:00100000:3.0:1783969536.919787:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1783969536.919799:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+22:15652:x1870627074094976:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:3.0:1783969536.919825:0:19100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969536.919851:0:19100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cbb418 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x129fb3d356303d80 expref: -99 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.919900:0:19100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cbb41f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.919917:0:19100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cbb41f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.919929:0:19100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cbb41f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.920072:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0200/0xea31253a47cbb418 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d80 expref: 24 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.920093:0:19100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ea813a0a00/0xea31253a47cbb41f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0x129fb3d356303d80 expref: 23 pid: 19100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.920103:0:19100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93e98216e000) 00010000:00010000:3.0:1783969536.920106:0:19100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783969536.920110:0:19100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ea813a0a00, rc 0) 00000100:00100000:3.0:1783969536.920173:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a97a32d-150e-48b4-af23-95f3386e92f5+23:15652:x1870627074094976:12345-192.168.201.34@tcp:101:dd.0 Request processed in 377us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969536.920180:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00010000:00010000:2.0:1783969536.920395:0:17116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.920410:0:17116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783969536.920473:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+22:15653:x1870627074094848:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 7048us (11100us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1783969536.920482:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000020:00080000:2.0:1783969536.920486:0:17116:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783969536.923481:0:17100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969536.923524:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.923537:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea837bda00 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:3.0:1783969536.923541:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.923553:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.923577:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93eab9b3ca00) 00010000:00010000:3.0:1783969536.923580:0:17100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783969536.923586:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.923593:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ea837bda00/0xea31253a47cbb411 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.923618:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969536.923620:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969536.923621:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969537.106560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1783969537.107253:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1783969537.107451:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074095232 00000100:00100000:3.0:1783969537.107466:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074095232 00000100:00100000:3.0:1783969537.107546:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627074095104 00000100:00100000:3.0:1783969537.107550:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627074095104 00000100:00100000:3.0:1783969537.107572:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1783969537.107584:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+8:2394:x1870627074095232:12345-192.168.201.34@tcp:4:dd.0 00002000:00010000:3.0:1783969537.107648:0:18626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a5536ff, atime: 0x6a5536fe, ctime: 0x6a5536ff, blocks: 0x0 00010000:00010000:3.0:1783969537.107657:0:18626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969537.107684:0:18626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=599s v=(0 0) 00010000:00010000:3.0:1783969537.107689:0:18626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969537.107694:0:18626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969537.107718:0:18626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969537.264699:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783969537.291160:0:19435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1783969537.291184:0:19435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1783969537.291604:0:18626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1783969537.291613:0:18626:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1783969535 -> 1783969536 00002000:00010000:0.0:1783969537.291628:0:18626:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783969535 -> 1783969536 00002000:00010000:0.0:1783969537.291630:0:18626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1783969537.291902:0:18626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.291917:0:18626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.291926:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.291934:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ea813a0200 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969537.291953:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.291964:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.291986:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.291994:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da3cc4f9/0xea31253a47cbb426 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969537.292662:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+6:2394:x1870627074095232:12345-192.168.201.34@tcp:4:dd.0 Request processed in 185073us (186111us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783969537.292679:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1783969537.292717:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:0.0:1783969537.292732:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074095104:12345-192.168.201.34@tcp:4:dd.0 00002000:00010000:0.0:1783969537.292775:0:18626:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a553700, atime: 0x6a5536fe, ctime: 0x6a553700, blocks: 0x1a68 00010000:00010000:0.0:1783969537.292783:0:18626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.292796:0:18626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=599s v=(0 0) 00010000:00010000:0.0:1783969537.292801:0:18626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969537.292808:0:18626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.292823:0:18626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969537.396307:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969537.396343:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea86fb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099342720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783969537.396462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969537.399324:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099342720 00000100:00100000:3.0:1783969537.399348:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099342720 00000100:00100000:3.0:1783969537.399465:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969537.399478:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099342720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783969537.399516:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783969537.399635:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1870627099342720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (3172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969537.399643:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969537.399715:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea86fb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1870627099342720:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783969537.402471:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1783969537.404208:0:19435:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1783969537.404501:0:18626:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1783969537.404526:0:18626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.404540:0:18626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.404550:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.404558:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93e983ddd600 already unused, calling callback (ffffffffc0d02230) 00010000:00010000:0.0:1783969537.404564:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.404574:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.404598:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.404606:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020a545a3/0xea31253a47cbb42d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969537.404752:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1a97a32d-150e-48b4-af23-95f3386e92f5+5:2394:x1870627074095104:12345-192.168.201.34@tcp:4:dd.0 Request processed in 112019us (297497us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783969537.404929:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00010000:00010000:3.0:1783969538.288694:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969538.416656:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969538.416754:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099342976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969538.416878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969538.416932:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969538.416939:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea86fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099343104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783969538.416970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969538.417178:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099342976 00000100:00100000:1.0:1783969538.417189:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099342976 00000100:00100000:1.0:1783969538.417255:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783969538.417265:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099342976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783969538.417311:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1783969538.417363:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099342976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969538.417371:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783969538.417450:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93eabf851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099342976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783969538.417486:0:19683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099343104 00000100:00100000:1.0:1783969538.417489:0:19683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099343104 00000100:00100000:1.0:1783969538.417536:0:19683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783969538.417543:0:19683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099343104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783969538.417559:0:19683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:1.0:1783969538.417594:0:19683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870627099343104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969538.417601:0:19683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1783969538.417616:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969538.417641:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea86fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1870627099343104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783969538.418102:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea86fb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099342848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969538.418147:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969538.419317:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099342848 00000100:00100000:1.0:1783969538.419334:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099342848 00000100:00100000:1.0:1783969538.419448:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783969538.419462:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099342848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969538.419495:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:1.0:1783969538.419581:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabf851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870627099342848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969538.419733:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1783969538.419752:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93eac1578000, transno 8589934596 00000004:00080000:3.0:1783969538.419776:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1783969538.419808:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea86fb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1870627099342848:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783969538.420523:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969538.421005:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783969538.423232:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099343232:0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.423240:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099343488:0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.423303:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099343360:0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.427482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969538.427560:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099344000:0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.427604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969538.427639:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783969538.427647:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099343616:0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.428240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969538.428276:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099344128:0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.428307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969538.428370:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099344000 00000100:00100000:3.0:1783969538.428423:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099344000 00000100:00100000:3.0:1783969538.428517:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099343616 00000100:00100000:3.0:1783969538.428521:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099343616 00000100:00100000:3.0:1783969538.428543:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099344128 00000100:00100000:3.0:1783969538.428546:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099344128 00000100:00100000:3.0:1783969538.428566:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783969538.428576:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099344000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.428649:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870627099344000:12345-0@lo:400:kworker.0 Request processed in 73us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969538.428658:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783969538.430169:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783969538.430191:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099343616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.430285:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870627099343616:12345-0@lo:400:kworker.0 Request processed in 103us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969538.430293:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783969538.430306:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1783969538.430312:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783969538.430318:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969538.430331:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099344128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.430362:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98262ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870627099344128:12345-0@lo:400:kworker.0 Request processed in 34us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969538.430362:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969538.430367:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783969538.430416:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099343360 00000100:00100000:0.0:1783969538.430422:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099343360 00000100:00100000:3.0:1783969538.430432:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870627099343616:0@lo:400:kworker.0 00010000:00080000:3.0:1783969538.430451:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983efd500 x1870627099344128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969538.430463:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1870627099344128:0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.430470:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969538.430477:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1870627099344000:0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.430477:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099343360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.430513:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1870627099343360:12345-0@lo:400:kworker.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969538.430519:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969538.430525:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099343488 00000100:00100000:3.0:1783969538.430528:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099343488 00000100:00080000:3.0:1783969538.430548:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969538.430550:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1870627099343360:0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.430563:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099343872:0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.430584:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969538.430592:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099343488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.430596:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969538.430616:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099344384:0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.430626:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93e98319f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099343488:12345-0@lo:400:kworker.0 Request processed in 35us (3159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969538.430632:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783969538.430639:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969538.430649:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099343872 00000100:00100000:3.0:1783969538.430652:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099343872 00000100:00100000:0.0:1783969538.430761:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099344384 00000100:00100000:0.0:1783969538.430764:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099344384 00000100:00100000:0.0:1783969538.430794:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783969538.430801:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099343872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.430855:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1870627099343872:12345-0@lo:400:kworker.0 Request processed in 37us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969538.430870:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783969538.430907:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1870627099343872:0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.430923:0:19100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783969538.430931:0:19100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea85f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099344384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.430967:0:19100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea85f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1870627099344384:12345-0@lo:400:kworker.0 Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969538.430974:0:19100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1783969538.430995:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93e983efd880 x1870627099344384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969538.431006:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1870627099344384:0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.432276:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099343488:0@lo:400:kworker.0 00000100:00080000:0.0:1783969538.432358:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783969538.439101:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969538.439170:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099343744:0@lo:400:kworker.0 00000100:00100000:2.0:1783969538.439223:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969538.439776:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93e983eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099344256:0@lo:400:kworker.0 00000100:00100000:2.0:1783969538.439816:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969538.439902:0:19100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099344256 00000100:00100000:2.0:1783969538.439912:0:19100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099344256 00000100:00080000:2.0:1783969538.439953:0:17108:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969538.440012:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783969538.440023:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac1579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099344256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969538.440094:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac1579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870627099344256:12345-0@lo:400:kworker.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969538.440103:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783969538.440162:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1870627099344256:0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.441201:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099343232 00000100:00100000:3.0:1783969538.441212:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099343232 00000100:00100000:3.0:1783969538.441277:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783969538.441289:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eabbf59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:3648:x1870627099343232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969538.441369:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eabbf59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:451c11fa-8d33-493c-b495-458f5de7342a+24:3648:x1870627099343232:12345-0@lo:400:kworker.0 Request processed in 83us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969538.441425:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783969538.443134:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:451c11fa-8d33-493c-b495-458f5de7342a:3648:1870627099343232:0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.444590:0:18923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099343744 00000100:00100000:0.0:1783969538.444609:0:18923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099343744 00000100:00100000:0.0:1783969538.444694:0:18923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969538.444708:0:18923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93eac157ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099343744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.444829:0:18923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93eac157ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870627099343744:12345-0@lo:400:kworker.0 Request processed in 125us (5605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969538.445511:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93e983efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1870627099343744:0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.445830:0:18923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783969538.936228:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff93ea86fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099344512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783969538.936311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969538.936367:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627099344512 00000100:00100000:1.0:1783969538.936374:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627099344512 00000100:00100000:1.0:1783969538.936453:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783969538.936926:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93ea86fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099344512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783969538.936961:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783969538.937028:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93ea86fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870627099344512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969538.937036:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783969538.937190:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff93ea86fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1870627099344512:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1783969539.006278:0:17148:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783969539.006287:0:17148:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969539.006309:0:17148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783969539.006315:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1783969539.316745:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783969539.459555:0:20290:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1783969540.337185:0:17100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969541.361678:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43952 lines, 43952 kept, 0 dropped, 0 bad.